DeepSpeed
[zero3] ensure only ds params are gathered
#1044
Merged

[zero3] ensure only ds params are gathered #1044

stas00
stas00 ensure only ds params are gathered
17845e8c
stas00 stas00 requested a review from arashashari arashashari 4 years ago
stas00 stas00 requested a review from awan-10 awan-10 4 years ago
stas00 stas00 requested a review from cli99 cli99 4 years ago
stas00 stas00 requested a review from conglongli conglongli 4 years ago
stas00 stas00 requested a review from eltonzheng eltonzheng 4 years ago
stas00 stas00 requested a review from jeffra jeffra 4 years ago
stas00 stas00 requested a review from minjiaz minjiaz 4 years ago
stas00 stas00 requested a review from niumanar niumanar 4 years ago
stas00 stas00 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
stas00 stas00 requested a review from samyam samyam 4 years ago
stas00 stas00 requested a review from ShadenSmith ShadenSmith 4 years ago
stas00 stas00 requested a review from tjruwase tjruwase 4 years ago
stas00
tjruwase
tjruwase approved these changes on 2021-05-13
tjruwase Merge branch 'master' into gather-only-ds-params
9700a54f
tjruwase Merge branch 'master' into gather-only-ds-params
ffc78d38
tjruwase tjruwase merged 29b444b6 into master 4 years ago
stas00 stas00 deleted the gather-only-ds-params branch 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone