vllm
[Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend
#32936

Merged

[Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend #32936

njhill merged 3 commits into vllm-project:main from izhuhaoran:MRV2-cg-mode-verify

izhuhaoran requested a review from

WoosukKwon 110 days ago

izhuhaoran requested a review from

youkaichao 110 days ago

izhuhaoran requested a review from

robertgshaw2-redhat 110 days ago

izhuhaoran requested a review from

mgoin 110 days ago

izhuhaoran requested a review from

tlrmchlsmth 110 days ago

izhuhaoran requested a review from

houseroad 110 days ago

izhuhaoran requested a review from

hmellor 110 days ago

izhuhaoran requested a review from

yewentao256 110 days ago

izhuhaoran requested a review from

ProExpertProg 110 days ago

mergify added nvidia

mergify added v1

izhuhaoran force pushed 77 days ago

izhuhaoran requested a review from

njhill 73 days ago

izhuhaoran closed this 63 days ago

izhuhaoran reopened this 63 days ago

mergify added needs-rebase

izhuhaoran force pushed 63 days ago

mergify removed needs-rebase

izhuhaoran force pushed 62 days ago

njhill commented on 2026-03-12

support cudagraph model verify for model runner v2

49d60d28

izhuhaoran force pushed to 49d60d28 35 days ago

izhuhaoran changed the title ~~[Model Runner V2] support cudagraph check based on attn backend~~ [Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend 35 days ago

fix lint error

64bcff7c

njhill approved these changes on 2026-04-09

njhill added ready

Merge branch 'main' into MRV2-cg-mode-verify

94cde92a

njhill merged 8f121f78 into main 33 days ago

Reviewers

njhill

WoosukKwon

youkaichao

robertgshaw2-redhat

mgoin

tlrmchlsmth

houseroad

hmellor

yewentao256

ProExpertProg

Assignees

No one assigned

Labels

ready v1 nvidia

Milestone

No milestone

vllm [Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend #32936 Merged

[Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend #32936

vllm
[Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend
#32936

Merged