vllm
[Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement
#36710

Merged

[Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement #36710

noooop merged 2 commits into main from wentao-optimize-compute-maxsim

optimize compute maxsim using batched version

14cfdb51

yewentao256 requested a review from

noooop 146 days ago

yewentao256 requested a review from

WoosukKwon 146 days ago

yewentao256 requested a review from

njhill 146 days ago

mergify added frontend

mergify added v1

yewentao256 added ready

gemini-code-assist commented on 2026-03-10

DarkLight1337 commented on 2026-03-11

DarkLight1337 approved these changes on 2026-03-11

Merge branch 'main' into wentao-optimize-compute-maxsim

0eb1b437

noooop merged c34ba6b9 into main 145 days ago

noooop deleted the wentao-optimize-compute-maxsim branch 145 days ago

Reviewers

DarkLight1337

gemini-code-assist

noooop

WoosukKwon

njhill

Assignees

No one assigned

Labels

frontend ready v1

Milestone

No milestone