DeepSpeed
Changing monitor loss to aggregate loss over gradient accumulation steps
#3428
Merged

Changing monitor loss to aggregate loss over gradient accumulation steps #3428

jomayeri merged 14 commits into master from jomayeri/issue-3367
jomayeri
jomayeri Changing monitor loss to aggregate loss over gas.
33bd1da3
jomayeri jomayeri requested a review from jeffra jeffra 2 years ago
jomayeri jomayeri requested a review from tjruwase tjruwase 2 years ago
tjruwase
tjruwase commented on 2023-05-02
jomayeri Adding self.losses to engine constructor.
9c9070d2
jomayeri Merge branch 'master' into jomayeri/issue-3367
a342686f
jomayeri Merge branch 'master' into jomayeri/issue-3367
ca3e1717
jomayeri Merge branch 'master' into jomayeri/issue-3367
8c15a56a
jomayeri Merge branch 'master' into jomayeri/issue-3367
322726c1
jomayeri Merge branch 'master' into jomayeri/issue-3367
66ec4d16
jomayeri Merge branch 'master' into jomayeri/issue-3367
e7e14575
tjruwase Merge branch 'master' into jomayeri/issue-3367
6e41e5ff
jomayeri Merge branch 'master' into jomayeri/issue-3367
adc0d1fa
tjruwase
tjruwase approved these changes on 2023-05-10
jomayeri jomayeri enabled auto-merge (squash) 2 years ago
jomayeri Merge branch 'master' into jomayeri/issue-3367
d741aae0
jomayeri Merge branch 'master' into jomayeri/issue-3367
2f799a6e
jomayeri Merge branch 'master' into jomayeri/issue-3367
f826cfb4
jomayeri Merge branch 'master' into jomayeri/issue-3367
cc64fbfe
jomayeri jomayeri merged 4d269c6e into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone