DeepSpeed
Add loss scale guard to avoid inf loop
#1958
Merged

Add loss scale guard to avoid inf loop #1958

jeffra merged 1 commit into master from qanthony/loss_scaler_guard
Quentin-Anthony
Quentin-Anthony Add loss scale guard to avoid inf loop
e83b6cad
Quentin-Anthony Quentin-Anthony requested a review from jeffra jeffra 4 years ago
Quentin-Anthony Quentin-Anthony requested a review from samyam samyam 4 years ago
Quentin-Anthony Quentin-Anthony requested a review from tjruwase tjruwase 4 years ago
Quentin-Anthony Quentin-Anthony requested a review from ShadenSmith ShadenSmith 4 years ago
Quentin-Anthony Quentin-Anthony requested a review from conglongli conglongli 4 years ago
Quentin-Anthony Quentin-Anthony requested a review from awan-10 awan-10 4 years ago
Quentin-Anthony Quentin-Anthony requested a review from cli99 cli99 4 years ago
Quentin-Anthony Quentin-Anthony requested a review from eltonzheng eltonzheng 4 years ago
Quentin-Anthony Quentin-Anthony requested a review from minjiaz minjiaz 4 years ago
Quentin-Anthony Quentin-Anthony requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
jeffra
jeffra approved these changes on 2022-05-17
jeffra jeffra merged 44085856 into master 4 years ago
jeffra jeffra deleted the qanthony/loss_scaler_guard branch 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone