vllm
[torch.compile] Make inductor partition rules respect splitting_ops #25691
#25845
Merged
Overview
Commits
111
Changes
View On GitHub

[torch.compile] Make inductor partition rules respect splitting_ops #25691 #25845

ProExpertProg merged 111 commits into vllm-project:main from baonudesifeizhai:feature/dynamic-inductor-partition-rules
baonudesifeizhai
baonudesifeizhai feat: preserve user splitting_ops in inductor graph partition
6df3516e
baonudesifeizhai Merge branch 'vllm-project:main' into feature/dynamic-inductor-partit…
454c7e68
baonudesifeizhai debugZ
08bdb8eb
baonudesifeizhai change torch version
0dc121ae
baonudesifeizhai change torch version
37a07a6f
baonudesifeizhai change torch
32127e5f
baonudesifeizhai update
63494501
baonudesifeizhai change
8c31edaa
baonudesifeizhai debug
02dc0f2d
baonudesifeizhai debug
6b6e24d1
baonudesifeizhai debug
e89fc823
baonudesifeizhai feat: complete dynamic partition rules implementation
04244bde
baonudesifeizhai debug
10458e04
baonudesifeizhai change
0d6821ca
baonudesifeizhai fix ruff and yapf
195ca5e9
baonudesifeizhai change test
aef7f806
baonudesifeizhai fix test
5a23f4fc
baonudesifeizhai fix user
5901e880
baonudesifeizhai fix ruff and yapf
d5f6b7ce
baonudesifeizhai baonudesifeizhai requested a review from simon-mo simon-mo 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from WoosukKwon WoosukKwon 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from youkaichao youkaichao 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from robertgshaw2-redhat robertgshaw2-redhat 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from mgoin mgoin 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from tlrmchlsmth tlrmchlsmth 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from houseroad houseroad 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from hmellor hmellor 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from yewentao256 yewentao256 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from ProExpertProg ProExpertProg 307 days ago
mergify mergify added ci/build
baonudesifeizhai baonudesifeizhai force pushed 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from sighingnow sighingnow 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from DarkLight1337 DarkLight1337 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from ywang96 ywang96 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from njhill njhill 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from comaniac comaniac 307 days ago
baonudesifeizhai baonudesifeizhai requested a review from alexm-redhat alexm-redhat 307 days ago
gemini-code-assist
gemini-code-assist commented on 2025-09-28
mergify mergify added documentation
mergify mergify added performance
mergify mergify added qwen
mergify mergify added v1
mergify mergify added tool-calling
baonudesifeizhai baonudesifeizhai force pushed 307 days ago
baonudesifeizhai baonudesifeizhai force pushed to d5f6b7ce 307 days ago
baonudesifeizhai fix: apply isort formatting to compilation.py
7e780f73
ProExpertProg
ProExpertProg requested changes on 2025-09-30
baonudesifeizhai Merge branch 'vllm-project:main' into feature/dynamic-inductor-partit…
dc29d191
baonudesifeizhai debuging
0582321f
baonudesifeizhai baonudesifeizhai requested a review from zou3519 zou3519 305 days ago
baonudesifeizhai debug
81f81c79
baonudesifeizhai change version of pytorch
12748926
baonudesifeizhai fix version problem
37c7fafd
baonudesifeizhai back to origin verision
90e180e5
baonudesifeizhai test version
e8429b5a
baonudesifeizhai change torch version >=2.9 only for debuging
f386d032
baonudesifeizhai
baonudesifeizhai fix for yapf
2ed3d364
baonudesifeizhai fix for Inductor
b5914d27
baonudesifeizhai fix
25ce9b26
baonudesifeizhai fix for test
d58853cf
baonudesifeizhai fix
077a9305
baonudesifeizhai fix for mypy error
0a391093
ProExpertProg
baonudesifeizhai Merge branch 'vllm-project:main' into feature/dynamic-inductor-partit…
7c2bf6ae
baonudesifeizhai Merge branch 'vllm-project:main' into feature/dynamic-inductor-partit…
f3e27697
baonudesifeizhai try to fix torch_bingings.cpp
7c28b02d
baonudesifeizhai fix
7af22943
baonudesifeizhai Merge branch 'vllm-project:main' into feature/dynamic-inductor-partit…
aedd4672
baonudesifeizhai reverse torch version
b1b11955
baonudesifeizhai Merge branch 'vllm-project:main' into feature/dynamic-inductor-partit…
cd0e2da7
baonudesifeizhai Merge branch 'vllm-project:main' into feature/dynamic-inductor-partit…
e27f2507
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
2c964a4b
angelayi
angelayi commented on 2025-10-03
baonudesifeizhai fix for reivewer suggestion
89306f35
baonudesifeizhai fix for test_config.py
17b519bc
baonudesifeizhai fix test_config.py
72e005d0
baonudesifeizhai fix and add second splits_ops
94a77d85
baonudesifeizhai change for _resolve_operator_overload
33c80c36
baonudesifeizhai change unique_names from debug to info
09649b28
baonudesifeizhai debuging
ec0abfeb
baonudesifeizhai
ProExpertProg
ProExpertProg
ProExpertProg commented on 2025-10-03
baonudesifeizhai baonudesifeizhai requested a review from LucasWilkinson LucasWilkinson 302 days ago
ProExpertProg
ProExpertProg commented on 2025-10-04
baonudesifeizhai
ProExpertProg
baonudesifeizhai
baonudesifeizhai baonudesifeizhai force pushed 301 days ago
baonudesifeizhai back to ecoabf and debuging
c4097510
baonudesifeizhai baonudesifeizhai force pushed to c4097510 301 days ago
baonudesifeizhai fix error
dba8684b
baonudesifeizhai extract compile_context to a function
efd29825
baonudesifeizhai fix for spllit_ops
338e6836
baonudesifeizhai fix mypy error
3ba2d3b7
baonudesifeizhai fix test_config.py
732a5ffc
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
e6f1bb25
baonudesifeizhai fix test_config.py
b366e054
baonudesifeizhai Merge branch 'feature/dynamic-inductor-partition-rules' of https://gi…
cbb78a41
baonudesifeizhai fix test_config.py
0af08471
baonudesifeizhai fix for compliation.py
f3215c90
baonudesifeizhai
baonudesifeizhai Merge main and apply ruff formatting
de0af67d
baonudesifeizhai fix __closure__=None problem
0276acf9
ProExpertProg
ProExpertProg commented on 2025-10-06
zou3519
zou3519 commented on 2025-10-06
zou3519
zou3519 commented on 2025-10-06
zou3519
zou3519 commented on 2025-10-06
baonudesifeizhai tmp fix for try
23285b70
zou3519
zou3519 commented on 2025-10-06
baonudesifeizhai fix fror __parse_operator_name error
d9abb8b5
baonudesifeizhai
baonudesifeizhai add format change from vllm to pytorch
acbf7d7f
BoyuanFeng
BoyuanFeng commented on 2025-10-06
BoyuanFeng
BoyuanFeng commented on 2025-10-06
BoyuanFeng
BoyuanFeng commented on 2025-10-07
BoyuanFeng
BoyuanFeng commented on 2025-10-07
BoyuanFeng
BoyuanFeng commented on 2025-10-07
baonudesifeizhai try to use look_up in torch
3a1f1536
baonudesifeizhai add clear() in paritution_rules.py
b3ba60dd
baonudesifeizhai rename 1) partition_ops -> inductor_partition_ops, AND 2) split_ops -…
eb16f4a8
ProExpertProg
baonudesifeizhai documentation to the docstring for splitting_ops in compilation confi…
303f962a
baonudesifeizhai change is_torch_equal_or_newer in test_config
d86184e8
baonudesifeizhai change torch check back and add compile_context
3e6f62b6
baonudesifeizhai change return self.splitting_ops is not None and all to any
f19d78f2
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
eb8440d0
baonudesifeizhai change back num_cudagraph_captured=13
410a5514
baonudesifeizhai change pynvml.py format
a290b505
baonudesifeizhai Revert pynvml.py formatting changes
d4aa8ccf
baonudesifeizhai add .__closure__ check for torch 2.5
6cd40812
baonudesifeizhai
ProExpertProg
ProExpertProg commented on 2025-10-07
baonudesifeizhai baonudesifeizhai requested a review from patrickvonplaten patrickvonplaten 298 days ago
baonudesifeizhai baonudesifeizhai requested a review from bigPYJ1151 bigPYJ1151 298 days ago
baonudesifeizhai baonudesifeizhai requested a review from ApostaC ApostaC 298 days ago
baonudesifeizhai baonudesifeizhai requested a review from heheda12345 heheda12345 298 days ago
baonudesifeizhai baonudesifeizhai requested a review from russellb russellb 298 days ago
baonudesifeizhai baonudesifeizhai requested a review from aarnphm aarnphm 298 days ago
baonudesifeizhai baonudesifeizhai requested a review from NickLucche NickLucche 298 days ago
baonudesifeizhai baonudesifeizhai requested a review from 22quinn 22quinn 298 days ago
baonudesifeizhai baonudesifeizhai requested a review from chaunceyjiang chaunceyjiang 298 days ago
baonudesifeizhai baonudesifeizhai requested a review from jeejeelee jeejeelee 298 days ago
mergify mergify added deepseek
mergify mergify added frontend
mergify mergify added llama
mergify mergify added multi-modality
mergify mergify added new-model
mergify mergify added gpt-oss
mergify mergify added structured-output
mergify mergify added speculative-decoding
mergify
mergify mergify added tpu
mergify mergify added needs-rebase
mergify mergify added kv-connector
baonudesifeizhai baonudesifeizhai force pushed to 6cd40812 298 days ago
mergify mergify removed tpu
baonudesifeizhai sovle test_config.py
8316aa70
baonudesifeizhai change test_config.py for conflict
6b4696b5
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
1e7f1431
mergify mergify removed needs-rebase
baonudesifeizhai remove special syntax.
91108259
ProExpertProg
ProExpertProg approved these changes on 2025-10-07
baonudesifeizhai
ProExpertProg
ProExpertProg commented on 2025-10-07
ProExpertProg ProExpertProg requested a review from ProExpertProg ProExpertProg 298 days ago
baonudesifeizhai resovle change except any and all
7bdc5975
baonudesifeizhai change for all to test
2d69e4c3
baonudesifeizhai change back for any()
d78b4fcb
baonudesifeizhai change back set_splitting_ops_for_attn_fusion(self): to old one
151a4d13
baonudesifeizhai fix for docs/readthedocs.org:vllm and add deBrief docstring describi…
f730709b
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
bd2afd22
baonudesifeizhai
ProExpertProg ProExpertProg added this to the vllm==v0.12.0/torch==2.9.0 compilation improvements milestone 297 days ago
ProExpertProg ProExpertProg added torch.compile
ProExpertProg
ProExpertProg requested changes on 2025-10-08
ProExpertProg ProExpertProg added ready
baonudesifeizhai Update vllm/config/compilation.py
69f7b10b
baonudesifeizhai Update vllm/config/compilation.py
6f1d397c
baonudesifeizhai Merge branch 'vllm-project:main' into feature/dynamic-inductor-partit…
44223313
mergify
mergify mergify added needs-rebase
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
4820e929
mergify mergify removed needs-rebase
baonudesifeizhai baonudesifeizhai force pushed to 4820e929 297 days ago
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
d319d8c8
baonudesifeizhai fix _attention_ops
c0616f00
baonudesifeizhai change . type to ::type
f64593c6
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
0806beca
baonudesifeizhai add connvert to dot format for pytorch
e0a25ca9
baonudesifeizhai Merge branch 'feature/dynamic-inductor-partition-rules' of https://gi…
d15fee73
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
5c77599e
baonudesifeizhai
ProExpertProg
ProExpertProg requested changes on 2025-10-09
mergify
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
6f0bbb9e
mergify mergify added needs-rebase
mergify mergify removed needs-rebase
baonudesifeizhai change for resolve the op overload and compare to node.target
ebbe0011
baonudesifeizhai add _resolve_operators_safely function to filter ops for tmp
0eaa2af2
baonudesifeizhai fix import erorr for lookup_op
939419eb
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
d959b8ab
ProExpertProg
ProExpertProg commented on 2025-10-09
ProExpertProg ProExpertProg removed documentation
ProExpertProg ProExpertProg removed new-model
ProExpertProg ProExpertProg removed structured-output
ProExpertProg ProExpertProg removed frontend
ProExpertProg ProExpertProg removed speculative-decoding
ProExpertProg ProExpertProg removed ready
ProExpertProg ProExpertProg removed ci/build
ProExpertProg ProExpertProg removed v1
ProExpertProg ProExpertProg removed multi-modality
ProExpertProg ProExpertProg removed tool-calling
ProExpertProg ProExpertProg removed llama
ProExpertProg ProExpertProg removed qwen
ProExpertProg ProExpertProg removed deepseek
ProExpertProg ProExpertProg removed gpt-oss
ProExpertProg ProExpertProg removed kv-connector
mergify mergify added llama
ProExpertProg
ProExpertProg commented on 2025-10-09
baonudesifeizhai changed
ec4ac363
baonudesifeizhai Merge branch 'feature/dynamic-inductor-partition-rules' of https://gi…
14b65212
ProExpertProg
ProExpertProg commented on 2025-10-09
ProExpertProg
ProExpertProg approved these changes on 2025-10-09
ProExpertProg ProExpertProg added ready
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
56ae27de
ProExpertProg ProExpertProg enabled auto-merge (squash) 296 days ago
disabled auto-merge 296 days ago
Head branch was pushed to by a user without write access
mergify
mergify mergify added needs-rebase
mergify mergify removed needs-rebase
baonudesifeizhai baonudesifeizhai force pushed to 56ae27de 296 days ago
mergify
mergify mergify added needs-rebase
baonudesifeizhai Merge branch 'main' into feature/dynamic-inductor-partition-rules
7708a112
mergify mergify removed needs-rebase
baonudesifeizhai change for test_config.py remove unused funciton
d9a400e1
baonudesifeizhai node.target can be OpOverloadPacket, need to check .default
bbd1bbdd
ProExpertProg
ProExpertProg commented on 2025-10-10
baonudesifeizhai Update tests/compile/piecewise/test_simple.py
ad4419e4
ProExpertProg ProExpertProg enabled auto-merge (squash) 295 days ago
disabled auto-merge 295 days ago
Manually disabled by user
ProExpertProg ProExpertProg enabled auto-merge (squash) 295 days ago
ProExpertProg ProExpertProg changed the title Feature/dynamic inductor partition rules #25691 [torch.compile] Make inductor partition rules respect splitting_ops #25691 295 days ago
ProExpertProg ProExpertProg merged cddce79f into main 295 days ago
ProExpertProg
ProExpertProg commented on 2025-10-31

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
performance ready torch.compile llama
Milestone
torch==2.9.0 compilation improvements
Terms Of Use Privacy Policy Refund Policy Impressum