DeepSpeed
Add loss scale guard to avoid inf loop
#1958
Merged

Add loss scale guard to avoid inf loop #1958

jeffra merged 1 commit into master from qanthony/loss_scaler_guard
Quentin-Anthony
Quentin-Anthony Add loss scale guard to avoid inf loop
e83b6cad
Quentin-Anthony Quentin-Anthony requested a review from jeffra jeffra 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from samyam samyam 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from tjruwase tjruwase 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from ShadenSmith ShadenSmith 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from conglongli conglongli 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from awan-10 awan-10 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from cli99 cli99 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from eltonzheng eltonzheng 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from minjiaz minjiaz 3 years ago
Quentin-Anthony Quentin-Anthony requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
jeffra
jeffra approved these changes on 2022-05-17
jeffra jeffra merged 44085856 into master 3 years ago
jeffra jeffra deleted the qanthony/loss_scaler_guard branch 3 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone