DeepSpeed
Fix index out of range error in ZeRO optimizer
#202
Merged

Fix index out of range error in ZeRO optimizer #202

tjruwase merged 2 commits into master from olruwase/zero_index_out_of_range
tjruwase
tjruwase Fix index out of range error when parameter count is not multiple of …
8fca72f3
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 5 years ago
tjruwase tjruwase requested a review from jeffra jeffra 5 years ago
tjruwase tjruwase requested a review from samyam samyam 5 years ago
ShadenSmith
ShadenSmith
ShadenSmith approved these changes on 2020-04-24
tjruwase
tjruwase ZeRO unit test for empty partition
c2e2cb84
ShadenSmith
tjruwase tjruwase merged 512a0d4d into master 5 years ago
jeffra jeffra deleted the olruwase/zero_index_out_of_range branch 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone