PR #1841 [ZeRO-1] fix bug w. cpu-offload + > 1 GPU

[ZeRO-1] fix bug w. cpu-offload + > 1 GPU #1841

jeffra merged 2 commits into master from z1-offload-multigpu

add unit test for z1 offload bug

008ebd94

fix issue for z1+cpu-offload w. >1 gpus

1d705704

jeffra requested a review from

samyam 3 years ago

jeffra requested a review from

tjruwase 3 years ago

jeffra requested a review from

ShadenSmith 3 years ago

jeffra requested a review from

conglongli 3 years ago

jeffra requested a review from

awan-10 3 years ago

jeffra requested a review from

cli99 3 years ago

jeffra requested a review from

eltonzheng 3 years ago

jeffra requested a review from

minjiaz 3 years ago

jeffra requested a review from

RezaYazdaniAminabadi 3 years ago

tjruwase approved these changes on 2022-03-16

jeffra changed the title ~~[ZeRO] fix bug w. cpu-offload + > 1 GPU~~ [ZeRO-1] fix bug w. cpu-offload + > 1 GPU 3 years ago

jeffra merged 28434c00 into master 3 years ago

Reviewers

tjruwase

samyam

ShadenSmith

conglongli

awan-10

cli99

eltonzheng

minjiaz

Assignees

No one assigned

Labels

None yet

Milestone

No milestone