DeepSpeed
Fix repeated gradient scaling across pipeline stages
#8154

Merged

Fix repeated gradient scaling across pipeline stages #8154

tohtana merged 1 commit into deepspeedai:master from Functionhx:fix/pipeline-gradient-scaling

Fix pipeline gradient accumulation scaling

1cc1c820

Functionhx marked this pull request as ready for review 29 days ago

Functionhx requested a review from

loadams 29 days ago

Functionhx requested a review from

tohtana 29 days ago

Functionhx requested a review from

tjruwase 29 days ago

tohtana approved these changes on 2026-07-20

tohtana enabled auto-merge 26 days ago

PKUWZP approved these changes on 2026-07-20

tohtana merged d99a6429 into master 26 days ago

Reviewers

PKUWZP

tohtana

loadams

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone