DeepSpeed
ZeRO-1/2: fix offload_states() keeping the optimizer state on the device
#9016
Merged

ZeRO-1/2: fix offload_states() keeping the optimizer state on the device #9016

xylian86
xylian86 xylian86 requested a review from tjruwase tjruwase 15 days ago
xylian86 xylian86 requested a review from tohtana tohtana 15 days ago
xylian86 xylian86 requested a review from loadams loadams 15 days ago
chatgpt-codex-connector
hwchen2017 hwchen2017 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 14 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-11-05
sfc-gh-truwase
sfc-gh-truwase requested changes on 2026-11-05
sfc-gh-truwase
sfc-gh-truwase approved these changes on 2026-11-05
xylian86 xylian86 force pushed from b174689c to b6b31494 14 days ago
xylian86 xylian86 force pushed from b6b31494 to b174689c 14 days ago
xylian86 xylian86 enabled auto-merge 12 days ago
tohtana tohtana added needs-gpu-test
tohtana tohtana removed needs-gpu-test
pengdurice
xylian86 ZeRO-1/2: free the optimizer state in offload_states() and relink it …
20c87023
xylian86 Potential fix for pull request finding 'Defer elastic state linking u…
8cfa9c70
xylian86 ZeRO-1/2: test offload and reload before the first step
e27f82bc
xylian86 xylian86 force pushed from 44f64d3f to e27f82bc 5 hours ago
xylian86 Merge branch 'master' into xinyu/zero12-offload-states-optim-fragments
2eb2c98d
xylian86 xylian86 merged 40a9f40b into master 4 hours ago
xylian86 xylian86 deleted the xinyu/zero12-offload-states-optim-fragments branch 4 hours ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone