DeepSpeed
Manually calling step with DeepSpeed Adam passing in fp16 params
#361
Merged
Overview
Commits
1
Changes
View On GitHub

Manually calling step with DeepSpeed Adam passing in fp16 params #361

samyam merged 1 commit into staging-zero-dual-v2 from reza/deepspeed_adam_merge
samyam
change gpt2 pretrain to have DeepSpeed adam
6ad96f82
samyam samyam requested a review from arashashari arashashari 6 years ago
samyam samyam requested a review from awan-10 awan-10 6 years ago
samyam samyam requested a review from cli99 cli99 6 years ago
samyam samyam requested a review from conglongli conglongli 6 years ago
samyam samyam requested a review from eltonzheng eltonzheng 6 years ago
samyam samyam requested a review from jeffra jeffra 6 years ago
samyam samyam requested a review from minjiaz minjiaz 6 years ago
samyam samyam requested a review from niumanar niumanar 6 years ago
samyam samyam requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 6 years ago
samyam samyam requested a review from ShadenSmith ShadenSmith 6 years ago
samyam samyam requested a review from tjruwase tjruwase 6 years ago
samyam samyam merged 1a4a82b6 into staging-zero-dual-v2 6 years ago
jeffra jeffra deleted the reza/deepspeed_adam_merge branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum