transformers
[`distributed`] decoupled tp_plan and ep_plan
#48859
Merged

[`distributed`] decoupled tp_plan and ep_plan #48859

3outeille merged 68 commits into main from ep-plans
3outeille
3outeille 3outeille force pushed from 64cae902 to 2380fa70 40 days ago
3outeille 3outeille changed the title Separate the tensor and expert parallel plans (EP part 2) [`distributed`] decoupled tp_plan and ep_plan 40 days ago
HuggingFaceDocBuilderDev
3outeille 3outeille force pushed from 2380fa70 to 1d65182a 40 days ago
3outeille 3outeille force pushed from 1d65182a to bd13eea7 40 days ago
3outeille 3outeille force pushed from bd13eea7 to db95b9f5 40 days ago
3outeille 3outeille marked this pull request as ready for review 40 days ago
3outeille 3outeille force pushed from db95b9f5 to fbb99855 40 days ago
3outeille 3outeille force pushed from 8979bb08 to 87c30a87 40 days ago
3outeille 3outeille requested a review from ArthurZucker ArthurZucker 40 days ago
ArthurZucker
ArthurZucker commented on 2026-09-17
3outeille 3outeille force pushed from f98a6ee5 to be6a1bc9 38 days ago
3outeille 3outeille force pushed from 48f22141 to 64358795 38 days ago
github-actions
3outeille 3outeille force pushed from 64358795 to 98f6bbd8 38 days ago
3outeille 3outeille force pushed from 6b4e624f to 3bff0f7f 35 days ago
3outeille 3outeille requested a review from ArthurZucker ArthurZucker 31 days ago
3outeille 3outeille force pushed from 3bff0f7f to 113d4350 28 days ago
3outeille 3outeille force pushed from 113d4350 to 8363f8f2 28 days ago
3outeille 3outeille force pushed from 8363f8f2 to bb6e4833 28 days ago
3outeille 3outeille force pushed from bb6e4833 to ef44fc69 28 days ago
3outeille 3outeille force pushed from ef44fc69 to 3734a3b7 27 days ago
3outeille 3outeille force pushed from 3734a3b7 to b063a33f 27 days ago
ArthurZucker
ArthurZucker commented on 2026-09-30
3outeille 3outeille force pushed from b063a33f to f4394eec 26 days ago
3outeille 3outeille force pushed from f4394eec to bc047b2b 26 days ago
3outeille 3outeille force pushed from 11a1b41c to 16d0f832 26 days ago
3outeille 3outeille force pushed from 902f5685 to 3862c9db 25 days ago
3outeille Add dense and expert device mesh views with a MeshManager
eecb6a8a
3outeille cleaning
29f51267
3outeille clean
40745266
3outeille update
578af0e7
3outeille clean doc
083e2532
3outeille Use ep_size in the Kimi K2.5 expert parallel example
2e682969
3outeille Enable expert parallelism in the Mega MoE example
29eb5a36
3outeille warn once
d6090dfd
3outeille Add dense and expert device mesh views with a MeshManager
76ff6f0e
3outeille cleaning
9a1b525f
3outeille update
ce8657f9
3outeille clean doc
ea3aacba
3outeille Update src/transformers/distributed/mixin.py
d498e802
3outeille style: ruff import block formatting in distributed config
ce3f5760
3outeille add more comments
f8415e73
3outeille Decouple tp_plan and ep_plan for expert parallelism.
a115da8e
3outeille Match expert paths with a regex and keep only expert rules under toke…
271de167
3outeille revert change on warning
cc5200f9
3outeille Apply suggestion from @ArthurZucker
17f7b659
3outeille cleaning
ef837266
3outeille 3outeille force pushed from 3862c9db to ef837266 25 days ago
3outeille Add dense and expert device mesh views with a MeshManager
925415d4
3outeille cleaning
0c227f1d
3outeille clean
a5958d4e
3outeille update
65719164
3outeille clean doc
90fbd095
3outeille Use ep_size in the Kimi K2.5 expert parallel example
e4561f09
3outeille Enable expert parallelism in the Mega MoE example
7f4951f9
3outeille warn once
e65e3eaf
3outeille Add dense and expert device mesh views with a MeshManager
03af9e8b
3outeille cleaning
69a145b2
3outeille update
caa76409
3outeille clean doc
a3de4dc2
3outeille Update src/transformers/distributed/mixin.py
84cb4bee
3outeille style: ruff import block formatting in distributed config
b5521952
3outeille add more comments
d1cf2079
3outeille Decouple tp_plan and ep_plan for expert parallelism.
4b655fbf
3outeille Match expert paths with a regex and keep only expert rules under toke…
a4f11e3a
3outeille revert change on warning
a5cd182b
3outeille Apply suggestion from @ArthurZucker
3d45692b
3outeille cleaning
04752eb4
3outeille 3outeille force pushed from ef837266 to 04752eb4 22 days ago
3outeille fix
bcbb851d
3outeille Merge branch 'ep-mesh-infrastructure' of github.com:huggingface/trans…
d51aca88
3outeille Merge branch 'ep-plans' of github.com:huggingface/transformers into e…
448315ed
3outeille revert
877afeea
3outeille Merge branch 'main' into ep-mesh-infrastructure
0ec824f1
3outeille Merge branch 'ep-mesh-infrastructure' into ep-plans
c85c8bca
3outeille typo
cedde47c
3outeille Merge branch 'main' into ep-mesh-infrastructure
b62bbbcd
3outeille clearer
6a23a306
3outeille Merge branch 'ep-mesh-infrastructure' of github.com:huggingface/trans…
daac87a5
3outeille Merge branch 'main' into ep-mesh-infrastructure
6c73628e
3outeille clean
b4d81b5b
3outeille Merge branch 'ep-mesh-infrastructure' of github.com:huggingface/trans…
e3cc578e
3outeille Merge branch 'ep-mesh-infrastructure' into ep-plans
9bb2518a
3outeille cleaning
e0f70125
3outeille Merge branch 'ep-plans' of github.com:huggingface/transformers into e…
926ee709
3outeille Merge branch 'main' into ep-mesh-infrastructure
746b2c53
3outeille Merge branch 'ep-mesh-infrastructure' into ep-plans
0eac0f5c
ArthurZucker
ArthurZucker approved these changes on 2026-10-06
3outeille
3outeille Update src/transformers/distributed/utils.py
7b57dd23
3outeille Merge branch 'main' into ep-mesh-infrastructure
ec77a598
3outeille Update src/transformers/distributed/configuration_utils.py
7af3cbc9
3outeille linting
f37bc0f4
3outeille Merge branch 'ep-mesh-infrastructure' of github.com:huggingface/trans…
11f0a3d5
3outeille fix comment
a4d06939
3outeille Merge branch 'ep-mesh-infrastructure' into ep-plans
6a504c18
3outeille Merge branch 'main' into ep-mesh-infrastructure
812c060c
3outeille Merge branch 'ep-mesh-infrastructure' into ep-plans
430bb2e6
Base automatically changed from ep-mesh-infrastructure to main 21 days ago
3outeille Merge branch 'main' into ep-plans
8385e633
3outeille 3outeille enabled auto-merge 21 days ago
github-actions
3outeille 3outeille merged 2033cf02 into main 21 days ago
3outeille 3outeille deleted the ep-plans branch 21 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone