DeepSpeed
[zero3] release tmp memory when consolidating fp16 weights take2
#1223
Merged
Overview
Commits
4
Changes
View On GitHub

[zero3] release tmp memory when consolidating fp16 weights take2 #1223

tjruwase merged 4 commits into deepspeedai:master from stas00:less-mem-fp16-save-take2
stas00
stas00 release tmp memory when consolidating fp16 weights take2
fb4c7a94
stas00 stas00 requested a review from awan-10 awan-10 5 years ago
stas00 stas00 requested a review from cli99 cli99 5 years ago
stas00 stas00 requested a review from conglongli conglongli 5 years ago
stas00 stas00 requested a review from eltonzheng eltonzheng 5 years ago
stas00 stas00 requested a review from jeffra jeffra 5 years ago
stas00 stas00 requested a review from minjiaz minjiaz 5 years ago
stas00 stas00 requested a review from niumanar niumanar 5 years ago
stas00 stas00 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
stas00 stas00 requested a review from samyam samyam 5 years ago
stas00 stas00 requested a review from ShadenSmith ShadenSmith 5 years ago
stas00 stas00 requested a review from tjruwase tjruwase 5 years ago
stas00 cleanup
163063f8
tjruwase Merge branch 'master' into less-mem-fp16-save-take2
f10e140a
tjruwase
tjruwase approved these changes on 2021-07-13
tjruwase Merge branch 'master' into less-mem-fp16-save-take2
2639e2c2
tjruwase tjruwase merged 81039463 into master 5 years ago
stas00 stas00 deleted the less-mem-fp16-save-take2 branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum