DeepSpeed
AutoEP: reorder expert rows with gathers on the collective path
#8671
Merged

AutoEP: reorder expert rows with gathers on the collective path #8671

yh0903
yh0903 Reorder AutoEP expert rows with gathers instead of a copy, a scatter …
e6903b1d
yh0903 Read the AutoEP row-gather index contiguously and state the permutati…
4be217c1
yh0903 Test the AutoEP reorder in FP16, through strided rows and gradients, …
fcdf5210
yh0903 yh0903 force pushed from 640c9475 to fcdf5210 54 days ago
yh0903 yh0903 marked this pull request as ready for review 54 days ago
yh0903 yh0903 requested a review from tohtana tohtana 54 days ago
yh0903 yh0903 requested a review from hwchen2017 hwchen2017 54 days ago
yh0903 yh0903 requested a review from loadams loadams 54 days ago
yh0903 yh0903 requested a review from tjruwase tjruwase 54 days ago
pengdurice pengdurice added will-review
hwchen2017 hwchen2017 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 52 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-09-29
tohtana
tohtana requested changes on 2026-09-29
pengdurice
pengdurice approved these changes on 2026-09-29
pengdurice Merge branch 'master' into yh0903/autoep-gather-permute
dd4f0966
yh0903 Run AutoEP reorder tests in clean single-worker processes under pytes…
d741d2ee
yh0903
tohtana
tohtana approved these changes on 2026-10-01
tohtana tohtana enabled auto-merge 49 days ago
tohtana tohtana merged bfd29175 into master 49 days ago
tohtana tohtana added needs-gpu-test
tohtana tohtana removed needs-gpu-test

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone