vllm
88d64448
- Merge branch 'main' into wentao-optimize-model-runner-v2-sampler
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
43 days ago
Merge branch 'main' into wentao-optimize-model-runner-v2-sampler Signed-off-by: yewentao256 <zhyanwentao@126.com>
References
wentao-optimize-model-runner-v2-sampler
#35214 - [Perf] Optimize Sampler Redundant Copy for Model Runner v2, 1.8% Throughput Improvement
Author
yewentao256
Parents
aef79c52
0e5a9382
Loading