transformers
Add expert parallelism (EP) config support for Qwen3 MoE
#45436
Merged
Merged
Add expert parallelism (EP) config support for Qwen3 MoE #45436
ArthurZucker
merged
11 commits into
huggingface:main
from
AmineDiro:qwen3-moe-ep-v2
AmineDiro
changed the title
AmineDiro
changed the title 
ArthurZucker
approved these changes
on 2026-04-21
Add base_model_ep_plan to Qwen3OmniMoeTalkerTextConfig
d168c968
Add expert-only EP plan to Qwen3 MoE configs
1b4b8828
Use expert-only EP plan for Qwen3 MoE configs
dbf68c04
Remove comments from generated qwen3_vl_moe config
a29cc422
Merge branch 'main' into qwen3-moe-ep-v2
38181267
Apply repo consistency fixes
907b79d8
Merge branch 'main' into qwen3-moe-ep-v2
eb992ed7
Add base_model_ep_plan to qwen3_vl_moe and qwen3_omni_moe modular fil…
abdac348
Merge branch 'main' into qwen3-moe-ep-v2
cbe7a028
Fix base_model_ep_plan position in generated configs to match modular…
7276c5a8
Merge branch 'main' into qwen3-moe-ep-v2
a8d6232f
Login to write a write a comment.
Login via GitHub