vllm
[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops
#26502
Merged
Merged
[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops #26502
ProExpertProg
merged
39 commits into
vllm-project:main
from
morrison-turnansky:issue-20283-compilation-config
chatgpt-codex-connector
commented
on 2025-10-09
hmellor
commented
on 2025-10-09
ProExpertProg
commented
on 2025-10-09
ProExpertProg
commented
on 2025-10-13
added deprecation warning for use_inductor in CompilationConfig
5b46656e
added logic for init_backend to take in backend information
7f6e73aa
removed use_inductor from code paths
3688ac5f
added all as default for custom_ops field in CompilitionConfig, made …
cc540fae
updated test_enabled_ops
18c765db
toy llam tests passing
d99a58ac
removed unused parameter
30692532
Apply suggestion from @ProExpertProg
d6961a07
updated behaviour of custom ops initialziation
aaf805bf
saving progress
53c3fb7f
resolved comments for compilation
4fe33262
Apply suggestion from @ProExpertProg
78833584
resolved comments for custom_op
5acc937c
resolved comments cpu
6a1c87bc
Apply suggestion from @ProExpertProg
95e0a9f1
updated test_enabled_custom_ops to be consistent with new initialziation
798a7fa9
formattting
b1d6ca6b
Update vllm/config/compilation.py
13be66bc
Update vllm/config/vllm.py
c979a6f9
adjusted according to reviewer comments
620aadda
linting
01007f23
Update vllm/compilation/backends.py
bd153a2e
updated vllm custom op default behaviour so that non is appened if an…
a1a08a30
changed test_basic_correctness for new backend behaviour
40826c76
adjusted to 0. format
34a2460d
linting
6ba0620e
tpu fix
4c0cd9fd
made 0.level explicit in test_basic_correctness
14371c9e
Update vllm/config/vllm.py
70b554c4
changed default backed from inductor to
f500719d
updated according to comments
19ddc8d6
zou3519
approved these changes
on 2025-10-13
adjusted for comments
e438c43c
Update vllm/model_executor/custom_op.py
96e2c1ec
Update vllm/config/vllm.py
0f8e420c
Update vllm/config/compilation.py
975c9094
Update tests/compile/test_basic_correctness.py
65bc52ab
Update tests/compile/test_basic_correctness.py
51d4aa40
reviewer comments
5b5455cb
ProExpertProg
approved these changes
on 2025-10-13
Add version number to deprecation warning
c25bafb7
ProExpertProg
added this to the vllm==v0.12.0/torch==2.9.0 compilation improvements milestone 213 days ago
Reviewers
Assignees
No one assigned
Labels
ready
llama
Milestone
Login to write a write a comment.
Login via GitHub