DeepSpeed
Correct loss scale in ZeRO step
#2695
Merged

Correct loss scale in ZeRO step #2695

jomayeri merged 3 commits into master from jomayeri/bug-2686
jomayeri
jomayeri using correct loss scale in zero step
b99e42c6
jomayeri jomayeri requested a review from jeffra jeffra 2 years ago
jomayeri jomayeri requested a review from tjruwase tjruwase 2 years ago
jomayeri jomayeri requested a review from samyam samyam 2 years ago
jomayeri jomayeri requested a review from mrwyattii mrwyattii 2 years ago
tjruwase
tjruwase approved these changes on 2023-01-13
tjruwase Merge branch 'master' into jomayeri/bug-2686
55ce2b62
jomayeri Merge branch 'master' into jomayeri/bug-2686
4534f6b0
jomayeri jomayeri enabled auto-merge (squash) 2 years ago
jomayeri jomayeri merged fe728e3e into master 2 years ago
mrwyattii mrwyattii deleted the jomayeri/bug-2686 branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone