DeepSpeed
Unmanaged gradient accumulation: ZeRO stage 3 support
#8217

Merged

Unmanaged gradient accumulation: ZeRO stage 3 support #8217

sfc-gh-truwase merged 1 commit into master from sfc-gh-truwase/gas_mgmt_zero3

sfc-gh-truwase requested a review from

tjruwase 4 days ago

sfc-gh-truwase requested a review from

tohtana 4 days ago

sfc-gh-truwase requested a review from

loadams 4 days ago

chatgpt-codex-connector commented on 2026-08-05

sfc-gh-truwase requested a review from

stas00 4 days ago

Extend unmanaged gradient accumulation to ZeRO stage 3

ea671a56

sfc-gh-truwase force pushed from 25f58179 to ea671a56 4 days ago

stas00 approved these changes on 2026-08-05

sfc-gh-truwase merged e75d1150 into master 4 days ago

sfc-gh-truwase deleted the sfc-gh-truwase/gas_mgmt_zero3 branch 4 days ago

Reviewers

stas00

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone