PR #374 ZeRO-Offload passing model tests

ZeRO-Offload passing model tests #374

tjruwase merged 3 commits into staging-zero-dual-v4 from olruwase/zero_offload_fix_corner_case

Add ZeRO-Offload model tests

80b99c6a

tjruwase requested a review from

arashashari 6 years ago

tjruwase requested a review from

awan-10 6 years ago

tjruwase requested a review from

cli99 6 years ago

tjruwase requested a review from

conglongli 6 years ago

tjruwase requested a review from

eltonzheng 6 years ago

tjruwase requested a review from

jeffra 6 years ago

tjruwase requested a review from

minjiaz 6 years ago

tjruwase requested a review from

niumanar 6 years ago

tjruwase requested a review from

RezaYazdaniAminabadi 6 years ago

tjruwase requested a review from

samyam 6 years ago

tjruwase requested a review from

ShadenSmith 6 years ago

Format fixes

dbcebb83

Increate bucket size scaler

d1164337

RezaYazdaniAminabadi approved these changes on 2020-09-08

tjruwase merged 485a365f into staging-zero-dual-v4 6 years ago

Reviewers

RezaYazdaniAminabadi

arashashari

awan-10

cli99

conglongli

eltonzheng

jeffra

minjiaz

niumanar

samyam

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed ZeRO-Offload passing model tests #374 Merged

ZeRO-Offload passing model tests #374

DeepSpeed
ZeRO-Offload passing model tests
#374

Merged