transformers
[`distributed`] decoupled tp_plan and ep_plan
#48859
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
68
Changes
View On
GitHub
[`distributed`] decoupled tp_plan and ep_plan
#48859
3outeille
merged 68 commits into
main
from
ep-plans
3outeille
force pushed
from
64cae902
to
2380fa70
40 days ago
3outeille
changed the title
Separate the tensor and expert parallel plans (EP part 2)
[`distributed`] decoupled tp_plan and ep_plan
40 days ago
3outeille
force pushed
from
2380fa70
to
1d65182a
40 days ago
3outeille
force pushed
from
1d65182a
to
bd13eea7
40 days ago
3outeille
force pushed
from
bd13eea7
to
db95b9f5
40 days ago
3outeille
marked this pull request as ready for review
40 days ago
3outeille
force pushed
from
db95b9f5
to
fbb99855
40 days ago
3outeille
force pushed
from
8979bb08
to
87c30a87
40 days ago
3outeille
requested a review
from
ArthurZucker
40 days ago
ArthurZucker
commented on 2026-09-17
3outeille
force pushed
from
f98a6ee5
to
be6a1bc9
38 days ago
3outeille
force pushed
from
48f22141
to
64358795
38 days ago
3outeille
force pushed
from
64358795
to
98f6bbd8
38 days ago
3outeille
force pushed
from
6b4e624f
to
3bff0f7f
35 days ago
3outeille
requested a review
from
ArthurZucker
31 days ago
3outeille
force pushed
from
3bff0f7f
to
113d4350
28 days ago
3outeille
force pushed
from
113d4350
to
8363f8f2
28 days ago
3outeille
force pushed
from
8363f8f2
to
bb6e4833
28 days ago
3outeille
force pushed
from
bb6e4833
to
ef44fc69
28 days ago
3outeille
force pushed
from
ef44fc69
to
3734a3b7
27 days ago
3outeille
force pushed
from
3734a3b7
to
b063a33f
27 days ago
ArthurZucker
commented on 2026-09-30
3outeille
force pushed
from
b063a33f
to
f4394eec
26 days ago
3outeille
force pushed
from
f4394eec
to
bc047b2b
26 days ago
3outeille
force pushed
from
11a1b41c
to
16d0f832
26 days ago
3outeille
force pushed
from
902f5685
to
3862c9db
25 days ago
Add dense and expert device mesh views with a MeshManager
eecb6a8a
cleaning
29f51267
clean
40745266
update
578af0e7
clean doc
083e2532
Use ep_size in the Kimi K2.5 expert parallel example
2e682969
Enable expert parallelism in the Mega MoE example
29eb5a36
warn once
d6090dfd
Add dense and expert device mesh views with a MeshManager
76ff6f0e
cleaning
9a1b525f
update
ce8657f9
clean doc
ea3aacba
Update src/transformers/distributed/mixin.py
d498e802
style: ruff import block formatting in distributed config
ce3f5760
add more comments
f8415e73
Decouple tp_plan and ep_plan for expert parallelism.
a115da8e
Match expert paths with a regex and keep only expert rules under toke…
271de167
revert change on warning
cc5200f9
Apply suggestion from @ArthurZucker
17f7b659
cleaning
ef837266
3outeille
force pushed
from
3862c9db
to
ef837266
25 days ago
Add dense and expert device mesh views with a MeshManager
925415d4
cleaning
0c227f1d
clean
a5958d4e
update
65719164
clean doc
90fbd095
Use ep_size in the Kimi K2.5 expert parallel example
e4561f09
Enable expert parallelism in the Mega MoE example
7f4951f9
warn once
e65e3eaf
Add dense and expert device mesh views with a MeshManager
03af9e8b
cleaning
69a145b2
update
caa76409
clean doc
a3de4dc2
Update src/transformers/distributed/mixin.py
84cb4bee
style: ruff import block formatting in distributed config
b5521952
add more comments
d1cf2079
Decouple tp_plan and ep_plan for expert parallelism.
4b655fbf
Match expert paths with a regex and keep only expert rules under toke…
a4f11e3a
revert change on warning
a5cd182b
Apply suggestion from @ArthurZucker
3d45692b
cleaning
04752eb4
3outeille
force pushed
from
ef837266
to
04752eb4
22 days ago
fix
bcbb851d
Merge branch 'ep-mesh-infrastructure' of github.com:huggingface/trans…
d51aca88
Merge branch 'ep-plans' of github.com:huggingface/transformers into e…
448315ed
revert
877afeea
Merge branch 'main' into ep-mesh-infrastructure
0ec824f1
Merge branch 'ep-mesh-infrastructure' into ep-plans
c85c8bca
typo
cedde47c
Merge branch 'main' into ep-mesh-infrastructure
b62bbbcd
clearer
6a23a306
Merge branch 'ep-mesh-infrastructure' of github.com:huggingface/trans…
daac87a5
Merge branch 'main' into ep-mesh-infrastructure
6c73628e
clean
b4d81b5b
Merge branch 'ep-mesh-infrastructure' of github.com:huggingface/trans…
e3cc578e
Merge branch 'ep-mesh-infrastructure' into ep-plans
9bb2518a
cleaning
e0f70125
Merge branch 'ep-plans' of github.com:huggingface/transformers into e…
926ee709
Merge branch 'main' into ep-mesh-infrastructure
746b2c53
Merge branch 'ep-mesh-infrastructure' into ep-plans
0eac0f5c
ArthurZucker
approved these changes on 2026-10-06
Update src/transformers/distributed/utils.py
7b57dd23
Merge branch 'main' into ep-mesh-infrastructure
ec77a598
Update src/transformers/distributed/configuration_utils.py
7af3cbc9
linting
f37bc0f4
Merge branch 'ep-mesh-infrastructure' of github.com:huggingface/trans…
11f0a3d5
fix comment
a4d06939
Merge branch 'ep-mesh-infrastructure' into ep-plans
6a504c18
Merge branch 'main' into ep-mesh-infrastructure
812c060c
Merge branch 'ep-mesh-infrastructure' into ep-plans
430bb2e6
Base automatically changed from
ep-mesh-infrastructure
to
main
21 days ago
Merge branch 'main' into ep-plans
8385e633
3outeille
enabled auto-merge
21 days ago
3outeille
merged
2033cf02
into main
21 days ago
3outeille
deleted the ep-plans branch
21 days ago
Login to write a write a comment.
Login via GitHub
Reviewers
ArthurZucker
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub