DeepSpeed
[AutoTP] Support eager row-parallel output head training
#8538

Merged

[AutoTP] Support eager row-parallel output head training #8538

delock merged 2 commits into deepspeedai:master from 0z5a:feat/autotp-row-parallel-lm-head

0z5a requested a review from

hwchen2017 43 days ago

0z5a requested a review from

loadams 43 days ago

0z5a requested a review from

tjruwase 43 days ago

0z5a requested a review from

tohtana 43 days ago

chatgpt-codex-connector commented on 2026-09-16

0z5a changed the title ~~[AutoTP] Support eager row-parallel output head training (PR-E)~~ [AutoTP] Support eager row-parallel output head training 43 days ago

delock requested a review from

delock 42 days ago

jinyouzhi commented on 2026-09-18

[AutoTP] Support row-parallel output-head training and test scatter/g…

ecc25ac9

0z5a force pushed from 751e03e1 to ecc25ac9 41 days ago

Merge branch 'master' into feat/autotp-row-parallel-lm-head

a02295d3

delock approved these changes on 2026-09-20

delock enabled auto-merge 39 days ago

delock merged 468a8ad1 into master 39 days ago

Reviewers

delock

chatgpt-codex-connector

jinyouzhi

hwchen2017

loadams

tjruwase

tohtana

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed [AutoTP] Support eager row-parallel output head training #8538 Merged

[AutoTP] Support eager row-parallel output head training #8538

DeepSpeed
[AutoTP] Support eager row-parallel output head training
#8538

Merged