DeepSpeed
[zero3] params_to_reduce isn't always there
#1214
Merged

[zero3] params_to_reduce isn't always there #1214

tjruwase merged 2 commits into deepspeedai:master from stas00:patch-1
stas00
stas00 [zero3] params_to_reduce isn't always there
e1dab238
stas00 stas00 requested a review from awan-10 awan-10 4 years ago
stas00 stas00 requested a review from cli99 cli99 4 years ago
stas00 stas00 requested a review from conglongli conglongli 4 years ago
stas00 stas00 requested a review from eltonzheng eltonzheng 4 years ago
stas00 stas00 requested a review from jeffra jeffra 4 years ago
stas00 stas00 requested a review from minjiaz minjiaz 4 years ago
stas00 stas00 requested a review from niumanar niumanar 4 years ago
stas00 stas00 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
stas00 stas00 requested a review from samyam samyam 4 years ago
stas00 stas00 requested a review from ShadenSmith ShadenSmith 4 years ago
stas00 stas00 requested a review from tjruwase tjruwase 4 years ago
stas00 real fix
96031798
stas00
stas00 commented on 2021-07-09
tjruwase
tjruwase approved these changes on 2021-07-09
stas00
stas00 commented on 2021-07-09
tjruwase tjruwase merged 91f58c06 into master 4 years ago
stas00 stas00 deleted the patch-1 branch 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone