DeepSpeed
Fix the GPU memory usage of ZeRO-Offload (only update stage_1_and_2.py)
#7309

Merged

Fix the GPU memory usage of ZeRO-Offload (only update stage_1_and_2.py) #7309

sfc-gh-truwase merged 8 commits into deepspeedai:master from arminzhu:arminzhu-Zero-Offload-patch-2

Update stage_1_and_2.py

09ecb731

arminzhu requested a review from

tjruwase 218 days ago

arminzhu requested a review from

tohtana 218 days ago

sfc-gh-truwase commented on 2025-05-23

arminzhu commented on 2025-05-23

Merge branch 'master' into arminzhu-Zero-Offload-patch-2

af859287

Update stage_1_and_2.py

87e03705

Update stage_1_and_2.py

4332b36e

Update stage_1_and_2.py

24c885d3

Update stage_1_and_2.py

8114ca5f

Update stage_1_and_2.py

cdf0e0be

Update stage_1_and_2.py

ba8ef078

sfc-gh-truwase approved these changes on 2025-05-27

sfc-gh-truwase merged 17c8be07 into master 214 days ago

Reviewers

sfc-gh-truwase

tjruwase

tohtana

Assignees

No one assigned

Labels

None yet

Milestone

No milestone