DeepSpeed
Fix bug where ZeRO2 never uses the reduce method.
#4946

Merged

Fix bug where ZeRO2 never uses the reduce method. #4946

tjruwase merged 1 commit into deepspeedai:master from CurryRice233:master

remove rank=None

b4e519da

CurryRice233 requested a review from

tjruwase 1 year ago

CurryRice233 requested a review from

mrwyattii 1 year ago

tjruwase approved these changes on 2024-01-13

tjruwase merged a85b6e47 into master 1 year ago

Reviewers

tjruwase

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone