Add MuP optimizers #2043
loadams
merged
16 commits into
deepspeedai:master
from
mrwyattii:add-mup-opts
added paths for mup optimizers
6ac7e329
added tests
16a07e3b
formatting
a827a582
Merge branch 'master' into add-mup-opts
fa491de9
Merge branch 'master' into add-mup-opts
6320b919
Merge branch 'master' into add-mup-opts
fbb353b2
Merge branch 'master' into add-mup-opts
18f23955
Add license, fix missing distributed test, formatting
771ab572
Merge branch 'master' into add-mup-opts
eed3944c
loadams
commented
on 2023-08-23
Add mpi4py to confirm tests work
a99a4b06
Undo requirements change
6efe85b8
Move to runtime folder
b598be75
Rework to match new format
c33e45aa
missing comma
69b483ad
hidden dim fix
a279aa05
Merge branch 'master' into add-mup-opts
963a13f3
mrwyattii
commented
on 2023-08-24
loadams
approved these changes
on 2023-08-24
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub