DeepSpeed
Adagrad support in ZeRO
#3401
Merged
Overview
Commits
12
Changes
View On GitHub

Adagrad support in ZeRO #3401

tjruwase merged 12 commits into master from jomayeri/fix-adagrad-optimizer
jomayeri
jomayeri Adding torch.optim.Adagrad
730804c1
jomayeri Merge branch 'master' into jomayeri/fix-adagrad-optimizer
c9f571d0
jomayeri Merge branch 'master' into jomayeri/fix-adagrad-optimizer
8204f310
jomayeri adding adagrad for zero 1 2
291fa3de
jomayeri Merge branch 'master' into jomayeri/fix-adagrad-optimizer
6e0528db
jomayeri Merge branch 'master' into jomayeri/fix-adagrad-optimizer
6ce093a5
jomayeri Adding Adagrad support to zero 3.
afa60870
jomayeri jomayeri requested a review from jeffra jeffra 2 years ago
jomayeri jomayeri requested a review from tjruwase tjruwase 2 years ago
jomayeri jomayeri requested a review from samyam samyam 2 years ago
jomayeri jomayeri requested a review from mrwyattii mrwyattii 2 years ago
jomayeri Merge branch 'master' into jomayeri/fix-adagrad-optimizer
373014ed
tjruwase Merge branch 'master' into jomayeri/fix-adagrad-optimizer
861b5bde
tjruwase
tjruwase commented on 2023-05-02
tjruwase
tjruwase commented on 2023-05-02
tjruwase
tjruwase commented on 2023-05-02
tjruwase
tjruwase approved these changes on 2023-05-02
jomayeri Adding documentation and DeepSpeedCPUAdagrad to list.
f80d7911
tjruwase Merge branch 'master' into jomayeri/fix-adagrad-optimizer
a15ed853
jomayeri Merge branch 'master' into jomayeri/fix-adagrad-optimizer
968be75c
tjruwase tjruwase merged d3550dc8 into master 2 years ago
mrwyattii mrwyattii deleted the jomayeri/fix-adagrad-optimizer branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum