vllm
a4d70bef - [Model Runner V2] Reserve CUDA graph memory (#53306)

Commit
80 days ago
[Model Runner V2] Reserve CUDA graph memory (#53306) Signed-off-by: Anh Tran <anh.tran.3889@gmail.com> Signed-off-by: Nick Hill <nickhill123@gmail.com> Co-authored-by: Anh Tran <anh.tran.3889@gmail.com> Co-authored-by: anhtra3889 <anhtra@nvidia.com>
Author
Parents
Loading