PR #8232 Add configurable sum gradient reduction

Add configurable sum gradient reduction #8232

pengdurice merged 3 commits into deepspeedai:master from zupengwang:feature/gradient-allreduce-sum

Add configurable sum gradient reduction

1a3b05de

zupengwang marked this pull request as ready for review 13 days ago

zupengwang requested a review from

tjruwase 13 days ago

zupengwang requested a review from

tohtana 13 days ago

zupengwang requested a review from

loadams 13 days ago

chatgpt-codex-connector commented on 2026-08-07

pengdurice commented on 2026-08-07

Reject sum gradient reduction with DeepCompile

48065364

pengdurice commented on 2026-08-13

test(zero): compare sum and mean training trajectories

f612ed96

pengdurice approved these changes on 2026-08-15

pengdurice merged 1cae4920 into master 5 days ago

Reviewers

pengdurice

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone