vllm
5215c80a
- Merge commit '6e8d8c4afbddf725b34ef938616701869f5b3462' into sage/dbo-full-cudagraphsh
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
252 days ago
Merge commit '6e8d8c4afbddf725b34ef938616701869f5b3462' into sage/dbo-full-cudagraphsh Signed-off-by: yewentao256 <zhyanwentao@126.com>
References
#23693 - [Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM
Author
yewentao256
Parents
dd2a94fd
6e8d8c4a
Loading