vllm
4819bb87
- fix eager mode
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
270 days ago
fix eager mode Signed-off-by: Sage Moore <sage@neuralmagic.com>
References
#23693 - [Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM
Author
SageMoore
Parents
e283eff0
Loading