vllm
[Perf] Optimize async scheduling redundant copy, 0.9% E2E throughput improvement
#34029
Open

[Perf] Optimize async scheduling redundant copy, 0.9% E2E throughput improvement #34029

yewentao256 wants to merge 2 commits into main from wentao-optimize-async-scheduling-copy
yewentao256
yewentao256 optimize async scheduling redundant copy
99d3990f
yewentao256 yewentao256 requested a review from WoosukKwon WoosukKwon 1 day ago
yewentao256 yewentao256 requested a review from robertgshaw2-redhat robertgshaw2-redhat 1 day ago
yewentao256 yewentao256 requested a review from njhill njhill 1 day ago
yewentao256 yewentao256 requested a review from ywang96 ywang96 1 day ago
yewentao256 yewentao256 requested a review from alexm-redhat alexm-redhat 1 day ago
yewentao256 yewentao256 requested a review from heheda12345 heheda12345 1 day ago
yewentao256 yewentao256 requested a review from ApostaC ApostaC 1 day ago
yewentao256 yewentao256 requested a review from orozery orozery 1 day ago
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2026-02-07
yewentao256 update
6286b4a0
yewentao256 yewentao256 added ready

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone