DeepSpeed
Fix issue with empty grads for non-fused optimizers
#83

Merged

Fix issue with empty grads for non-fused optimizers #83

jeffra merged 4 commits into master from jeffra/empty_grad_fix

guard against empty gradients

1c759d7f

bug fixes for adamw/lamb and corresponding tests

391900b9

fix formatting

79ccfa7e

jeffra requested a review from

ShadenSmith 5 years ago

jeffra requested a review from

samyam 5 years ago

Merge branch 'master' into jeffra/empty_grad_fix

dce2d331

ShadenSmith approved these changes on 2020-02-15

samyam approved these changes on 2020-02-15

jeffra merged 807480a0 into master 5 years ago

jeffra deleted the jeffra/empty_grad_fix branch 5 years ago

Reviewers

samyam

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone