DeepSpeed
Fix silent gradient-bucket drop on CPU in ZeRO-1/2 non-contiguous reduction
#8382

Merged

Fix silent gradient-bucket drop on CPU in ZeRO-1/2 non-contiguous reduction #8382

delock merged 7 commits into deepspeedai:master from delock:fix/cpu-gradient-bucket-drop

delock requested a review from

tjruwase 43 days ago

delock requested a review from

tohtana 43 days ago

delock requested a review from

loadams 43 days ago

chatgpt-codex-connector commented on 2026-09-01

Fix silent gradient-bucket drop on CPU and CPU-invalid device in test…

ad3c27e5

delock force pushed from 3757a3b9 to ad3c27e5 43 days ago

ebarkhordar commented on 2026-09-02

Exclude sparse gradient layouts from ZeRO-1/2 reduction buckets

bfddd3c9

Merge branch 'master' into fix/cpu-gradient-bucket-drop

03adfbb3

Merge branch 'master' into fix/cpu-gradient-bucket-drop

f3b9a5be

Merge branch 'master' into fix/cpu-gradient-bucket-drop

0bfd34e2

Exclude non-strided tensor layouts from ZeRO-1/2 reduction buckets

6040bbc6

Merge branch 'master' into fix/cpu-gradient-bucket-drop

b982351f

pengdurice approved these changes on 2026-09-18

delock merged 20a60f22 into master 23 days ago

delock deleted the fix/cpu-gradient-bucket-drop branch 23 days ago

Reviewers

pengdurice

ebarkhordar

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone