DeepSpeed
Fix CPUAdam same-step subgroup drift in ZeRO-3 (#7819)
#7859

Closed

Fix CPUAdam same-step subgroup drift in ZeRO-3 (#7819) #7859

tohtana wants to merge 2 commits into deepspeedai:master from tohtana:tohtana/fix-issue7819-zero3-cpuadam-bias-correction

Fix CPUAdam same-step subgroup drift in ZeRO-3 (#7819)

d0882882

tohtana requested a review from

tjruwase 26 days ago

tohtana requested a review from

loadams 26 days ago

Merge branch 'master' into tohtana/fix-issue7819-zero3-cpuadam-bias-c…

36f32dc8

PKUWZP requested a review from

PKUWZP 26 days ago

PKUWZP approved these changes on 2026-02-18

tohtana closed this 26 days ago

Reviewers

PKUWZP

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone