PR #372 fix adam perormance

fix adam perormance #372

RezaYazdaniAminabadi merged 5 commits into staging-zero-dual-v3 from reza/fix_adam_perf

fixing corner cases

e6344450

revert to the previous perf for adam

f27e0aca

adam high performance

2b9f8b78

RezaYazdaniAminabadi requested a review from

arashashari 5 years ago

RezaYazdaniAminabadi requested a review from

awan-10 5 years ago

RezaYazdaniAminabadi requested a review from

cli99 5 years ago

RezaYazdaniAminabadi requested a review from

conglongli 5 years ago

RezaYazdaniAminabadi requested a review from

eltonzheng 5 years ago

RezaYazdaniAminabadi requested a review from

jeffra 5 years ago

RezaYazdaniAminabadi requested a review from

minjiaz 5 years ago

RezaYazdaniAminabadi requested a review from

niumanar 5 years ago

RezaYazdaniAminabadi requested a review from

samyam 5 years ago

RezaYazdaniAminabadi requested a review from

ShadenSmith 5 years ago

RezaYazdaniAminabadi requested a review from

tjruwase 5 years ago

tjruwase approved these changes on 2020-09-06

merging

6692cedf

run precommit

604f6493

RezaYazdaniAminabadi merged 75e9e320 into staging-zero-dual-v3 5 years ago

Reviewers

tjruwase

arashashari

awan-10

cli99

conglongli

eltonzheng

jeffra

minjiaz

niumanar

samyam

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed fix adam perormance #372 Merged

fix adam perormance #372

DeepSpeed
fix adam perormance
#372

Merged