DeepSpeed
Fix RuntimeError when using ZeRO Stage3 with mpu: #3564
#3565

Merged

Fix RuntimeError when using ZeRO Stage3 with mpu: #3564 #3565

tjruwase merged 3 commits into deepspeedai:master from eggiter:fix-3564

eggiter requested a review from

jeffra 2 years ago

eggiter requested a review from

tjruwase 2 years ago

eggiter requested a review from

samyam 2 years ago

eggiter requested a review from

mrwyattii 2 years ago

samadejacobs requested a review from

samadejacobs 2 years ago

samadejacobs approved these changes on 2023-06-01

Fix RuntimeError when using ZeRO Stage3 with mpu: #3564

4bbb4fdf

eggiter force pushed from b45af9e7 to 4bbb4fdf 2 years ago

Merge branch 'master' into fix-3564

6c5d1ea3

tjruwase enabled auto-merge (squash) 2 years ago

Merge branch 'master' into fix-3564

6a85689d

tjruwase merged f5dde36c into master 2 years ago

eggiter deleted the fix-3564 branch 2 years ago

Reviewers

samadejacobs

jeffra

tjruwase

samyam

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone