DeepSpeed
DeepSpeedZeroOptimizer_Stage3: remove cuda specific optimizer
#5138

Merged

DeepSpeedZeroOptimizer_Stage3: remove cuda specific optimizer #5138

tjruwase merged 7 commits into deepspeedai:master from nelyahu:stage3_fused_adam_removal

DeepSpeedZeroOptimizer_Stage3: remove cuda specific optimizer

a16423da

Merge branch 'microsoft:master' into stage3_fused_adam_removal

5cd0c40b

nelyahu requested a review from

tjruwase 2 years ago

nelyahu requested a review from

mrwyattii 2 years ago

tjruwase approved these changes on 2024-02-15

remove bias correction

2c2421c7

mrwyattii approved these changes on 2024-02-16

Merge branch 'master' into stage3_fused_adam_removal

96f9493e

Merge branch 'microsoft:master' into stage3_fused_adam_removal

4ef93e27

handle formatting issues

27767e49

Merge branch 'master' into stage3_fused_adam_removal

4e1ba07b

tjruwase merged 7f0950f8 into master 2 years ago

nelyahu deleted the stage3_fused_adam_removal branch 1 year ago

Reviewers

tjruwase

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone