PR #503 Fixing CPU-Adam convergence issue

Fixing CPU-Adam convergence issue #503

RezaYazdaniAminabadi merged 5 commits into master from reyazda/cpu-adam-fix1

fixing cpu-adam

bfb59ed7

RezaYazdaniAminabadi requested a review from

arashashari 5 years ago

RezaYazdaniAminabadi requested a review from

awan-10 5 years ago

RezaYazdaniAminabadi requested a review from

cli99 5 years ago

RezaYazdaniAminabadi requested a review from

conglongli 5 years ago

RezaYazdaniAminabadi requested a review from

eltonzheng 5 years ago

RezaYazdaniAminabadi requested a review from

jeffra 5 years ago

RezaYazdaniAminabadi requested a review from

minjiaz 5 years ago

RezaYazdaniAminabadi requested a review from

niumanar 5 years ago

RezaYazdaniAminabadi requested a review from

samyam 5 years ago

RezaYazdaniAminabadi requested a review from

ShadenSmith 5 years ago

RezaYazdaniAminabadi requested a review from

tjruwase 5 years ago

fixing copy with optimizer for data and model parallelism

6743e6d5

samyam approved these changes on 2020-11-04

fixing cpu-adam

c111825e

jeffra approved these changes on 2020-11-05

tjruwase requested changes on 2020-11-05

fix cpu-adam

320694d7

fix cpu-adam

f73059cb

RezaYazdaniAminabadi requested a review from

tjruwase 5 years ago

tjruwase approved these changes on 2020-11-05

RezaYazdaniAminabadi merged 7d4d742b into master 5 years ago

mrwyattii deleted the reyazda/cpu-adam-fix1 branch 2 years ago

Reviewers

tjruwase

jeffra

samyam

arashashari

awan-10

cli99

conglongli

eltonzheng

minjiaz

niumanar

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Fixing CPU-Adam convergence issue #503 Merged

Fixing CPU-Adam convergence issue #503

DeepSpeed
Fixing CPU-Adam convergence issue
#503

Merged