DeepSpeed
Generalize detection of ZeRO supported optimizers
#349

Merged

Generalize detection of ZeRO supported optimizers #349

tjruwase merged 8 commits into staging-zero-dual-v2 from olruwase/zero-offload-valid-optimizers

Improve test for ZeRO supported optimizers

ce37c9e5

Rename test function

cf80db3a

Format fixes

9d1c673d

tjruwase requested a review from

arashashari 5 years ago

tjruwase requested a review from

awan-10 5 years ago

tjruwase requested a review from

cli99 5 years ago

tjruwase requested a review from

conglongli 5 years ago

tjruwase requested a review from

eltonzheng 5 years ago

tjruwase requested a review from

jeffra 5 years ago

tjruwase requested a review from

minjiaz 5 years ago

tjruwase requested a review from

niumanar 5 years ago

tjruwase requested a review from

RezaYazdaniAminabadi 5 years ago

tjruwase requested a review from

samyam 5 years ago

tjruwase requested a review from

ShadenSmith 5 years ago

Add model tests that wraps client FusedAdam with fused fp16 optimizer

750f0a39

Merge branch 'staging-zero-dual-v2' of github.com:microsoft/DeepSpeed…

16a91ffb

ShadenSmith approved these changes on 2020-09-04

jeffra approved these changes on 2020-09-04

Merge branch 'staging-zero-dual-v2' of github.com:microsoft/DeepSpeed…

49579fe4

Format fixes

1f2e8a64

Merge branch 'staging-zero-dual-v2' of github.com:microsoft/DeepSpeed…

1f438c75

tjruwase merged 253b0447 into staging-zero-dual-v2 5 years ago

jeffra deleted the olruwase/zero-offload-valid-optimizers branch 4 years ago

Reviewers

jeffra

ShadenSmith

arashashari

awan-10

cli99

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Generalize detection of ZeRO supported optimizers #349 Merged

Generalize detection of ZeRO supported optimizers #349

DeepSpeed
Generalize detection of ZeRO supported optimizers
#349

Merged