DeepSpeed
Release overlap_comm & contiguous_gradients restrictions for ZeRO 1
#4887

Merged

Release overlap_comm & contiguous_gradients restrictions for ZeRO 1 #4887

tjruwase merged 2 commits into deepspeedai:master from li-plus:opt-zero1

li-plus requested a review from

mrwyattii 1 year ago

li-plus requested a review from

tjruwase 1 year ago

Release overlap_comm & contiguous_gradients restrictions for ZeRO 1

4ec2151a

li-plus force pushed from 7945f526 to 4ec2151a 1 year ago

Merge branch 'master' into opt-zero1

1d9c381a

tjruwase approved these changes on 2024-01-05

tjruwase merged af033831 into master 1 year ago

li-plus deleted the opt-zero1 branch 1 year ago

Reviewers

tjruwase

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone