PR #546 Adding static_loss_scale to unfused optimizer

Adding static_loss_scale to unfused optimizer #546

samyam merged 2 commits into master from samyamr/zero-2-debug

Adding static_loss_scale to unfused optimizer

a06d9ffc

samyam requested a review from

arashashari 5 years ago

samyam requested a review from

awan-10 5 years ago

samyam requested a review from

cli99 5 years ago

samyam requested a review from

conglongli 5 years ago

samyam requested a review from

eltonzheng 5 years ago

samyam requested a review from

jeffra 5 years ago

samyam requested a review from

minjiaz 5 years ago

samyam requested a review from

niumanar 5 years ago

samyam requested a review from

RezaYazdaniAminabadi 5 years ago

samyam requested a review from

ShadenSmith 5 years ago

samyam requested a review from

tjruwase 5 years ago

eltonzheng approved these changes on 2020-11-21

jeffra approved these changes on 2020-11-21

Merge branch 'master' into samyamr/zero-2-debug

cc57e46e

samyam merged bcd56f97 into master 5 years ago

Reviewers

jeffra

eltonzheng

arashashari

awan-10

cli99

conglongli

minjiaz

niumanar

RezaYazdaniAminabadi

ShadenSmith

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Adding static_loss_scale to unfused optimizer #546 Merged

Adding static_loss_scale to unfused optimizer #546

DeepSpeed
Adding static_loss_scale to unfused optimizer
#546

Merged