DeepSpeed
Normalize ZeRO-3 DeepCompile grad dtype before reduction
#8038

Merged

Normalize ZeRO-3 DeepCompile grad dtype before reduction #8038

tohtana merged 3 commits into deepspeedai:master from tohtana:tohtana/fix/deepcompile-zero3-grad-dtype-buckets

tohtana requested a review from

tjruwase 14 days ago

tohtana requested a review from

loadams 14 days ago

chatgpt-codex-connector commented on 2026-05-30

compile: normalize ZeRO-3 DeepCompile grad dtype

2c15ad9f

tohtana force pushed from be9d1d07 to 2c15ad9f 14 days ago

eternalNight approved these changes on 2026-06-04

Merge branch 'master' into tohtana/fix/deepcompile-zero3-grad-dtype-b…

a4e56555

tohtana enabled auto-merge (squash) 7 days ago

PKUWZP requested a review from

PKUWZP 7 days ago

PKUWZP approved these changes on 2026-06-07

Merge branch 'master' into tohtana/fix/deepcompile-zero3-grad-dtype-b…

31994519

tohtana merged 4f5fb834 into master 4 days ago

Reviewers

PKUWZP

eternalNight

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone