ZeRO-1/2: fix offload_states() keeping the optimizer state on the device #9016
xylian86
force pushed
from
b174689c
to
b6b31494
14 days ago
xylian86
force pushed
from
b6b31494
to
b174689c
14 days ago
ZeRO-1/2: free the optimizer state in offload_states() and relink it …
20c87023
Potential fix for pull request finding 'Defer elastic state linking u…
8cfa9c70
ZeRO-1/2: test offload and reload before the first step
e27f82bc
xylian86
force pushed
from
44f64d3f
to
e27f82bc
5 hours ago
Merge branch 'master' into xinyu/zero12-offload-states-optim-fragments
2eb2c98d
xylian86
merged
40a9f40b
into master 4 hours ago
xylian86
deleted the xinyu/zero12-offload-states-optim-fragments branch 4 hours ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub