vllm
aef79c52
- Merge branch 'main' into wentao-optimize-model-runner-v2-sampler
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
54 days ago
Merge branch 'main' into wentao-optimize-model-runner-v2-sampler
References
#35214 - [Perf] Optimize Sampler Redundant Copy for Model Runner v2, 1.8% Throughput Improvement
Author
yewentao256
Parents
aeb03ccd
612e7729
Loading