vllm
a4d70bef
- [Model Runner V2] Reserve CUDA graph memory (#53306)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
80 days ago
[Model Runner V2] Reserve CUDA graph memory (#53306) Signed-off-by: Anh Tran <anh.tran.3889@gmail.com> Signed-off-by: Nick Hill <nickhill123@gmail.com> Co-authored-by: Anh Tran <anh.tran.3889@gmail.com> Co-authored-by: anhtra3889 <anhtra@nvidia.com>
References
#53306 - [Model Runner V2] Reserve CUDA graph memory
Author
njhill
Parents
8c2bbe00
Loading