[Model Runner V2] support piecewise & mixed cudagraph #32771
WoosukKwon
merged
19 commits into
vllm-project:main
from
izhuhaoran:MRV2-support-piecewise
init support piecewise cudagraph for model runner v2
6ba668d9
gemini-code-assist
commented
on 2026-01-21
cursor
commented
on 2026-01-21
fix lint error
18a968da
set batch_descriptor for piecewise cudagraph in execute_model
a293775d
fix cudagraph capture for eagle
0c4f91dc
fix mixed cg for spec decode
730654ed
LucasWilkinson
commented
on 2026-01-23
use diff capture sizes for uniform_decode full cudagraph
3d9a0c83
fix lint
26729fc4
Merge branch 'main' into MRV2-support-piecewise
454a85b4
fix slot_mappings_by_layer error after merge
030c9dfe
refactor get_cudagraph_sizes and fix eagle cudagraph size too large i…
ad4d8fb7
Merge remote-tracking branch 'origin/main' into MRV2-support-piecewise
893bff89
Merge branch 'main' into MRV2-support-piecewise
b5498f2d
support piecewise for spec in MRV2
4a46af83
fix mypy error
2e3e94a0
apply suggestions from @njhill
c2e4f379
Merge remote-tracking branch 'origin/main' into MRV2-support-piecewise
7859ea8d
remove no need args for BatchDescriptor
538fb958
format to remove extra loc
c1183192
merge
2f5d512b
WoosukKwon
approved these changes
on 2026-02-18
Assignees
No one assigned
Labels
v1
nvidia
Milestone
No milestone
Login to write a write a comment.
Login via GitHub