vllm
[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level
#26355

Merged

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level #26355

ProExpertProg merged 31 commits into vllm-project:main from morrison-turnansky:issue-20283-level

mergify added documentation

mergify added llama

mergify added speculative-decoding

mergify added v1

mergify added tpu

mergify added needs-rebase

morrison-turnansky force pushed 299 days ago

mergify removed needs-rebase

morrison-turnansky marked this pull request as ready for review 299 days ago

morrison-turnansky requested a review from

NickLucche 299 days ago

morrison-turnansky requested a review from

jikunshang 299 days ago

morrison-turnansky requested a review from

bigPYJ1151 299 days ago

morrison-turnansky requested a review from

benchislett 299 days ago

morrison-turnansky requested a review from

luccafong 299 days ago

morrison-turnansky requested a review from

WoosukKwon 299 days ago

morrison-turnansky requested a review from

robertgshaw2-redhat 299 days ago

morrison-turnansky requested a review from

njhill 299 days ago

morrison-turnansky requested a review from

ywang96 299 days ago

morrison-turnansky requested a review from

comaniac 299 days ago

morrison-turnansky requested a review from

alexm-redhat 299 days ago

morrison-turnansky requested a review from

simon-mo 299 days ago

morrison-turnansky requested a review from

youkaichao 299 days ago

morrison-turnansky requested a review from

mgoin 299 days ago

morrison-turnansky requested a review from

tlrmchlsmth 299 days ago

morrison-turnansky requested a review from

houseroad 299 days ago

morrison-turnansky requested a review from

hmellor 299 days ago

morrison-turnansky requested a review from

yewentao256 299 days ago

morrison-turnansky requested a review from

ProExpertProg 299 days ago

morrison-turnansky requested a review from

zou3519 299 days ago

hmellor commented on 2025-10-07

morrison-turnansky changed the title ~~Issue 20283 level~~ [Frontend] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level 299 days ago

ProExpertProg changed the title ~~[Frontend] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level~~ [Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level 299 days ago

ProExpertProg commented on 2025-10-07

mergify added needs-rebase

morrison-turnansky force pushed 298 days ago

mergify removed needs-rebase

morrison-turnansky force pushed 298 days ago

morrison-turnansky requested a review from

ProExpertProg 298 days ago

ProExpertProg commented on 2025-10-08

morrison-turnansky requested a review from

aarnphm 298 days ago

morrison-turnansky requested a review from

chaunceyjiang 298 days ago

mergify added frontend

morrison-turnansky force pushed 298 days ago

mergify added needs-rebase

morrison-turnansky force pushed 297 days ago

mergify removed needs-rebase

morrison-turnansky requested a review from

ProExpertProg 297 days ago

mergify added needs-rebase

morrison-turnansky force pushed 293 days ago

mergify removed needs-rebase

morrison-turnansky force pushed 293 days ago

ProExpertProg commented on 2025-10-13

morrison-turnansky force pushed 293 days ago

mergify added needs-rebase

morrison-turnansky force pushed 293 days ago

mergify removed needs-rebase

ProExpertProg added this to the vllm==v0.12.0/torch==2.9.0 compilation improvements milestone 293 days ago

ProExpertProg commented on 2025-10-14

morrison-turnansky force pushed 292 days ago

ProExpertProg approved these changes on 2025-10-14

ProExpertProg added ready

ProExpertProg commented on 2025-10-14

ProExpertProg approved these changes on 2025-10-14

name change CompilationLevel to CompilationMode

77cdf1a1

replaced dynamo_as_is with stock_torch_compile

1b9757d2

repalced dynamo once with dynamo trace once

5dac5d6c

replaced CompilationMode.PIECEWISE with CompilationMode.VLLM_COMPILE

009eec3b

added mode field for compilation config, deprecation warning for level

1bc8bff4

resolved comments

e84ff13e

added version numbers for deprecation notes

309747d0

merge cleanup

23d277a3

update compilation_config.level to compilation_config.mode

05399e99

updated descriptions of compilation mode

36df9740

changed level to mode

ee02319b

cleanup

9237b673

removed comment about v0 compilation

de233a47

linting

3961df75

fixed after rebase

cca5a018

linting

386a569e

Update tests/v1/cudagraph/test_cudagraph_mode.py

257b092f

updated reviewer comments

9ffa460e

Update tests/compile/test_async_tp.py

99329c36

Update tests/distributed/test_sequence_parallel.py

f74d8dc8

Update tests/v1/cudagraph/test_cudagraph_mode.py

4f32d3ba

Update vllm/config/compilation.py

747869c2

Update vllm/config/compilation.py

a9a03451

Update vllm/config/vllm.py

966f0c42

Update vllm/config/compilation.py

83fe7676

Update vllm/config/compilation.py

17b1330f

removed comment about v0 compilation

de233a47

linting

3961df75

fixed after rebase

cca5a018

linting

386a569e

Update tests/v1/cudagraph/test_cudagraph_mode.py

257b092f

updated reviewer comments

9ffa460e

Update tests/compile/test_async_tp.py

99329c36

Update tests/distributed/test_sequence_parallel.py

f74d8dc8

Update tests/v1/cudagraph/test_cudagraph_mode.py

4f32d3ba

Update vllm/config/compilation.py

747869c2

Update vllm/config/compilation.py

a9a03451

Update vllm/config/vllm.py

966f0c42

Update vllm/config/compilation.py

83fe7676

reviewer comments

690cf886

reviewer comments

6f1385f9

fixed tests/model_executor/test_enabled_custom_ops.py::test_enabled_…

79708c16

reviewer commemnts

e138bdf7

updated after merge

4a53a649

morrison-turnansky force pushed to 4a53a649 292 days ago

ProExpertProg approved these changes on 2025-10-15

zou3519 commented on 2025-10-15

ProExpertProg enabled auto-merge (squash) 292 days ago

ProExpertProg merged 96b9aa5a into main 292 days ago

Reviewers

ProExpertProg

zou3519

hmellor

NickLucche

jikunshang

bigPYJ1151

benchislett

luccafong

WoosukKwon

robertgshaw2-redhat

njhill

ywang96

comaniac

alexm-redhat

simon-mo

youkaichao

mgoin

tlrmchlsmth

houseroad

yewentao256

aarnphm

chaunceyjiang

Assignees

No one assigned

Labels

documentation frontend tpu speculative-decoding ready v1 llama

Milestone

torch==2.9.0 compilation improvements

vllm [Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level #26355 Merged

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level #26355

vllm
[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level
#26355

Merged