vllm
5bbfd95b
- add support for multiple builders in the model runner
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
258 days ago
add support for multiple builders in the model runner Signed-off-by: Sage Moore <sage@neuralmagic.com>
References
#23693 - [Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM
Author
SageMoore
Parents
6b0c303a
Loading