vllm
ffb3d553 - [Model Runner V2] Init cuda graph pool when necessary (#33217)

Commit

1 day ago

[Model Runner V2] Init cuda graph pool when necessary (#33217) Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>

References

Author

xinyu-intel

Parents