PR #166 Adding static loss scaling for ZeRO.

Adding static loss scaling for ZeRO. #166

ShadenSmith merged 2 commits into deepspeedai:master from ShadenSmith:zero_static

Adding static loss scaling for ZeRO.

62496a96

ShadenSmith requested a review from

samyam 6 years ago

Merge branch 'master' into zero_static

989451f5

tjruwase approved these changes on 2020-03-23

ShadenSmith merged a76572dc into master 6 years ago

ShadenSmith deleted the zero_static branch 6 years ago

Reviewers

tjruwase

samyam

Assignees

No one assigned

Labels

None yet

Milestone

No milestone