DeepSpeed
Expect AutoTP to keep a row-parallel output head tied to the embedding
#8855
Merged
Merged
Expect AutoTP to keep a row-parallel output head tied to the embedding #8855
delock
merged
5 commits into
deepspeedai:master
from
jinyouzhi:fix-tied-row-head-test
Expect AutoTP to keep a row-parallel output head tied to the embedding
568e27b8
Run TestTiedOutputHead on 2 ranks so the nightly covers it
50b46228
Run TestTiedOutputHead in the CPU multi-rank nightly
9399f871
Keep TestTiedOutputHead at 4 ranks
6f385398
delock
approved these changes
on 2026-10-20
Merge branch 'master' into fix-tied-row-head-test
1e01cc48
Login to write a write a comment.
Login via GitHub