DeepSpeed
Assert ZeRO-Offload incompatible with gradient accumulation
#347
Merged
Overview
Commits
1
Changes
View On GitHub

Assert ZeRO-Offload incompatible with gradient accumulation #347

tjruwase merged 1 commit into staging-zero-dual-v2 from olruwase/zero_offload_disable_grad_accum
tjruwase
tjruwase Assert ZeRO-Offload+gradient accumulation
bbc87b47
tjruwase tjruwase requested a review from arashashari arashashari 5 years ago
tjruwase tjruwase requested a review from awan-10 awan-10 5 years ago
tjruwase tjruwase requested a review from cli99 cli99 5 years ago
tjruwase tjruwase requested a review from conglongli conglongli 5 years ago
tjruwase tjruwase requested a review from eltonzheng eltonzheng 5 years ago
tjruwase tjruwase requested a review from jeffra jeffra 5 years ago
tjruwase tjruwase requested a review from minjiaz minjiaz 5 years ago
tjruwase tjruwase requested a review from niumanar niumanar 5 years ago
tjruwase tjruwase requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
tjruwase tjruwase requested a review from samyam samyam 5 years ago
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 5 years ago
jeffra
jeffra approved these changes on 2020-09-03
tjruwase tjruwase merged 0159ebba into staging-zero-dual-v2 5 years ago
jeffra jeffra deleted the olruwase/zero_offload_disable_grad_accum branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum