DeepSpeed
Samyamr/grad acc stage2
#338
Merged
Overview
Commits
9
Changes
View On GitHub

Samyamr/grad acc stage2 #338

samyam merged 9 commits into master from samyamr/grad-acc-stage2
samyam
samyam Adding gradient accumulation support for ZeRO Stage 2. Changing all M…
a1cf86fd
samyam Gradient Accumulation support for Stage 2. Model tests added to test …
0b12dc1e
samyam samyam requested a review from jeffra jeffra 5 years ago
samyam samyam requested a review from tjruwase tjruwase 5 years ago
samyam samyam requested a review from arashashari arashashari 5 years ago
samyam samyam requested a review from awan-10 awan-10 5 years ago
samyam samyam requested a review from cli99 cli99 5 years ago
samyam samyam requested a review from conglongli conglongli 5 years ago
samyam samyam requested a review from eltonzheng eltonzheng 5 years ago
samyam samyam requested a review from minjiaz minjiaz 5 years ago
samyam samyam requested a review from niumanar niumanar 5 years ago
samyam samyam requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
samyam samyam requested a review from ShadenSmith ShadenSmith 5 years ago
jeffra Merge branch 'master' into samyamr/grad-acc-stage2
03d63caa
samyam formatting
cafd9f2d
samyam Merge branch 'samyamr/grad-acc-stage2' of github.com:microsoft/DeepSp…
d54ef562
samyam Update deepspeed_light.py
1c88e9d0
samyam Update ds_config_func_bs8_zero1.json
2f07fac9
tjruwase
tjruwase approved these changes on 2020-08-31
samyam defining baseline prefix
67cf7280
samyam Merge branch 'samyamr/grad-acc-stage2' of github.com:microsoft/DeepSp…
b7deede3
samyam samyam merged 7240abf3 into master 5 years ago
jeffra jeffra deleted the samyamr/grad-acc-stage2 branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum