DeepSpeed
Fix perf bug from ZeRO n^2 data copies
#194
Merged

Fix perf bug from ZeRO n^2 data copies #194

tjruwase merged 2 commits into master from olruwase/zero_slow_step
tjruwase
tjruwase Fix perf bug
3fa3aafb
tjruwase tjruwase added bug
tjruwase tjruwase requested a review from samyam samyam 5 years ago
tjruwase tjruwase changed the title Fix perf bug from ZeRO redundant data copies Fix perf bug from ZeRO n^2 data copies 5 years ago
tjruwase tjruwase requested a review from jeffra jeffra 5 years ago
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 5 years ago
Merge branch 'master' into olruwase/zero_slow_step
d6c9334f
ShadenSmith
ShadenSmith approved these changes on 2020-04-20
tjruwase tjruwase merged bf4797c2 into master 5 years ago
jeffra jeffra deleted the olruwase/zero_slow_step branch 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone