DeepSpeed
Hotfix ZeRO-1 memory/convergence fixes
#527
Merged

Hotfix ZeRO-1 memory/convergence fixes #527

jeffra
jeffra updates to simplify and fix memory/convergence bugs
b911e5bc
jeffra disable model tests
a0644d84
jeffra jeffra requested a review from tjruwase tjruwase 5 years ago
tjruwase
tjruwase approved these changes on 2020-11-14
jeffra jeffra merged fba92f19 into saksham-zero1-fixes 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone