PR #273 Handle parameter groups smaller than DP

Handle parameter groups smaller than DP #273

tjruwase merged 4 commits into master from olruwase/zero_relevance_bug

Load non-DeepSpeed checkpoints into ZeRO optimizer

c023cc6a

Handle parameters smaller than DP

69d17ab7

tjruwase requested a review from

jeffra 5 years ago

tjruwase requested a review from

samyam 5 years ago

Formatting fixes

f2c74c54

Merge branch 'master' into olruwase/zero_relevance_bug

bade64d8

samyam approved these changes on 2020-06-23

tjruwase merged 88c319aa into master 5 years ago

jeffra deleted the olruwase/zero_relevance_bug branch 4 years ago

Reviewers

samyam

jeffra

Assignees

No one assigned

Labels

None yet

Milestone

No milestone