DeepSpeed
[zero3] GatheredParameters can now handle a list of params
#884
Merged
Overview
Commits
12
Changes
View On GitHub

[zero3] GatheredParameters can now handle a list of params #884

jeffra merged 12 commits into deepspeedai:master from stas00:GatheredParameters-list
stas00
stas00 GatheredParameters can now handle a list of params
0a30e13a
stas00 stas00 requested a review from arashashari arashashari 4 years ago
stas00 stas00 requested a review from awan-10 awan-10 4 years ago
stas00 stas00 requested a review from cli99 cli99 4 years ago
stas00 stas00 requested a review from conglongli conglongli 4 years ago
stas00 stas00 requested a review from eltonzheng eltonzheng 4 years ago
stas00 stas00 requested a review from jeffra jeffra 4 years ago
stas00 stas00 requested a review from minjiaz minjiaz 4 years ago
stas00 stas00 requested a review from niumanar niumanar 4 years ago
stas00 stas00 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
stas00 stas00 requested a review from samyam samyam 4 years ago
stas00 stas00 requested a review from ShadenSmith ShadenSmith 4 years ago
stas00 stas00 requested a review from tjruwase tjruwase 4 years ago
stas00 fix
5a9e789c
stas00 stas00 changed the title [wip] GatheredParameters can now handle a list of params [wip] [zero3] GatheredParameters can now handle a list of params 4 years ago
stas00 add Pretrained model loading example
3c574585
stas00 stas00 changed the title [wip] [zero3] GatheredParameters can now handle a list of params [zero3] GatheredParameters can now handle a list of params 4 years ago
samyam
samyam commented on 2021-03-23
samyam
samyam commented on 2021-03-23
stas00 optimizer - thanks @samyam
a983ac33
stas00 simplify
b834faed
stas00 fix
6dfcd1dd
samyam
samyam approved these changes on 2021-03-23
stas00 style
d5ca2007
tjruwase Merge branch 'master' into GatheredParameters-list
8d1a5491
tjruwase Merge branch 'master' into GatheredParameters-list
6b56aebf
tjruwase Merge branch 'master' into GatheredParameters-list
34070353
jeffra Merge branch 'master' into GatheredParameters-list
28b9db3d
jeffra
jeffra approved these changes on 2021-04-07
jeffra Merge branch 'master' into GatheredParameters-list
8a769fde
jeffra jeffra merged 6d94afb5 into master 4 years ago
stas00 stas00 deleted the GatheredParameters-list branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum