DeepSpeed
Samyamr/zero offload correctness
#359
Merged
Overview
Commits
2
Changes
View On GitHub

Samyamr/zero offload correctness #359

samyam merged 2 commits into staging-zero-dual-v2 from samyamr/zero-offload-correctness
samyam
samyam fixing gradient accumulation for zero offload
42269a97
samyam Bug fixes. ZeRO Stage 1,2 and Offload all produce the same loss with …
f55d5d13
samyam samyam requested a review from tjruwase tjruwase 6 years ago
samyam samyam requested a review from arashashari arashashari 6 years ago
samyam samyam requested a review from awan-10 awan-10 6 years ago
samyam samyam requested a review from cli99 cli99 6 years ago
samyam samyam requested a review from conglongli conglongli 6 years ago
samyam samyam requested a review from eltonzheng eltonzheng 6 years ago
samyam samyam requested a review from jeffra jeffra 6 years ago
samyam samyam requested a review from minjiaz minjiaz 6 years ago
samyam samyam requested a review from niumanar niumanar 6 years ago
samyam samyam requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 6 years ago
samyam samyam requested a review from ShadenSmith ShadenSmith 6 years ago
samyam samyam merged af512117 into staging-zero-dual-v2 6 years ago
jeffra jeffra deleted the samyamr/zero-offload-correctness branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum