DeepSpeed
Samyamr/zero offload correctness
#359
Merged
Overview
Commits
2
Changes
View On GitHub

Samyamr/zero offload correctness #359

samyam merged 2 commits into staging-zero-dual-v2 from samyamr/zero-offload-correctness
samyam
samyam fixing gradient accumulation for zero offload
42269a97
samyam Bug fixes. ZeRO Stage 1,2 and Offload all produce the same loss with …
f55d5d13
samyam samyam requested a review from tjruwase tjruwase 5 years ago
samyam samyam requested a review from arashashari arashashari 5 years ago
samyam samyam requested a review from awan-10 awan-10 5 years ago
samyam samyam requested a review from cli99 cli99 5 years ago
samyam samyam requested a review from conglongli conglongli 5 years ago
samyam samyam requested a review from eltonzheng eltonzheng 5 years ago
samyam samyam requested a review from jeffra jeffra 5 years ago
samyam samyam requested a review from minjiaz minjiaz 5 years ago
samyam samyam requested a review from niumanar niumanar 5 years ago
samyam samyam requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
samyam samyam requested a review from ShadenSmith ShadenSmith 5 years ago
samyam samyam merged af512117 into staging-zero-dual-v2 5 years ago
jeffra jeffra deleted the samyamr/zero-offload-correctness branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum