vllm
[Model Runner V2] Init cuda graph pool when necessary
#33217
Merged

[Model Runner V2] Init cuda graph pool when necessary #33217

xinyu-intel
xinyu-intel xinyu-intel requested a review from WoosukKwon WoosukKwon 16 days ago
mergify mergify added nvidia
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2026-01-28
WoosukKwon
WoosukKwon commented on 2026-02-04
xinyu-intel xinyu-intel force pushed 8 days ago
xinyu-intel init cuda graph pool when necessary
bed73dc8
xinyu-intel xinyu-intel force pushed to bed73dc8 8 days ago
xinyu-intel xinyu-intel requested a review from WoosukKwon WoosukKwon 8 days ago
DarkLight1337 DarkLight1337 requested a review from LucasWilkinson LucasWilkinson 7 days ago
ProExpertProg
ProExpertProg approved these changes on 2026-02-11
WoosukKwon WoosukKwon merged ffb3d553 into main 1 day ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone