DeepSpeed
Fix OneCycleLR zero division error
#1498
Merged

Fix OneCycleLR zero division error #1498

AnesBenmerzoug
Add regression test for onecyclelr zerodivision error
be86ddaa
Wrap computation of lr and mom decay factors in try except block
e5c41109
AnesBenmerzoug AnesBenmerzoug requested a review from awan-10 awan-10 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from cli99 cli99 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from conglongli conglongli 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from eltonzheng eltonzheng 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from jeffra jeffra 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from minjiaz minjiaz 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from niumanar niumanar 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from samyam samyam 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from ShadenSmith ShadenSmith 4 years ago
AnesBenmerzoug AnesBenmerzoug requested a review from tjruwase tjruwase 4 years ago
ghost
tjruwase
tjruwase commented on 2021-10-29
tjruwase
Use boolean attributes instead of try/except block
32c01a4e
tjruwase
tjruwase approved these changes on 2021-10-29
tjruwase tjruwase enabled auto-merge (squash) 4 years ago
AnesBenmerzoug
jeffra Merge branch 'master' into fix-onecycle-lr-zero-division-error
c097fdff
jeffra
tjruwase tjruwase merged db5d8ba2 into master 4 years ago
AnesBenmerzoug AnesBenmerzoug deleted the fix-onecycle-lr-zero-division-error branch 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone