PR #366 ZeRO-Offload passing model functionality tests

ZeRO-Offload passing model functionality tests #366

tjruwase merged 4 commits into staging-zero-dual-v2 from olruwase/zero_offload_e2e

cpu_offload enables overlap_comm and contiguous_gradients

636e842e

Model functionality tests now passing

88db5aa9

tjruwase requested a review from

jeffra 5 years ago

tjruwase requested a review from

samyam 5 years ago

tjruwase requested a review from

arashashari 5 years ago

tjruwase requested a review from

awan-10 5 years ago

tjruwase requested a review from

cli99 5 years ago

tjruwase requested a review from

conglongli 5 years ago

tjruwase requested a review from

eltonzheng 5 years ago

tjruwase requested a review from

minjiaz 5 years ago

tjruwase requested a review from

niumanar 5 years ago

tjruwase requested a review from

RezaYazdaniAminabadi 5 years ago

tjruwase requested a review from

ShadenSmith 5 years ago

Move to perf tests folder

6f0d0cf0

Merge branch 'staging-zero-dual-v2' into olruwase/zero_offload_e2e

bd429188

tjruwase merged aa3f2893 into staging-zero-dual-v2 5 years ago

Reviewers

jeffra

samyam

arashashari

awan-10

cli99

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed ZeRO-Offload passing model functionality tests #366 Merged

ZeRO-Offload passing model functionality tests #366

DeepSpeed
ZeRO-Offload passing model functionality tests
#366

Merged