DeepSpeed
Manually calling step with DeepSpeed Adam passing in fp16 params
#361

Merged

Manually calling step with DeepSpeed Adam passing in fp16 params #361

samyam merged 1 commit into staging-zero-dual-v2 from reza/deepspeed_adam_merge

change gpt2 pretrain to have DeepSpeed adam

6ad96f82

samyam requested a review from

arashashari 5 years ago

samyam requested a review from

awan-10 5 years ago

samyam requested a review from

cli99 5 years ago

samyam requested a review from

conglongli 5 years ago

samyam requested a review from

eltonzheng 5 years ago

samyam requested a review from

jeffra 5 years ago

samyam requested a review from

minjiaz 5 years ago

samyam requested a review from

niumanar 5 years ago

samyam requested a review from

RezaYazdaniAminabadi 5 years ago

samyam requested a review from

ShadenSmith 5 years ago

samyam requested a review from

tjruwase 5 years ago

samyam merged 1a4a82b6 into staging-zero-dual-v2 5 years ago

jeffra deleted the reza/deepspeed_adam_merge branch 4 years ago

Reviewers

arashashari

awan-10

cli99

conglongli

eltonzheng

jeffra

minjiaz

niumanar

RezaYazdaniAminabadi

ShadenSmith

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Manually calling step with DeepSpeed Adam passing in fp16 params #361 Merged

Manually calling step with DeepSpeed Adam passing in fp16 params #361

DeepSpeed
Manually calling step with DeepSpeed Adam passing in fp16 params
#361

Merged