DeepSpeed
[zero-1] ignore overlap/contiguous_gradients flags
#1246

Merged

[zero-1] ignore overlap/contiguous_gradients flags #1246

jeffra merged 3 commits into master from jeffra/z1-defaults

ignore overlap/contiguous_gradients if using zero 1

a0ef8459

jeffra requested a review from

awan-10 4 years ago

jeffra requested a review from

cli99 4 years ago

jeffra requested a review from

conglongli 4 years ago

jeffra requested a review from

eltonzheng 4 years ago

jeffra requested a review from

minjiaz 4 years ago

jeffra requested a review from

niumanar 4 years ago

jeffra requested a review from

RezaYazdaniAminabadi 4 years ago

jeffra requested a review from

samyam 4 years ago

jeffra requested a review from

ShadenSmith 4 years ago

jeffra requested a review from

tjruwase 4 years ago

tjruwase approved these changes on 2021-07-23

Merge branch 'master' into jeffra/z1-defaults

4afc1c78

Merge branch 'master' into jeffra/z1-defaults

23500010

samyam approved these changes on 2021-07-26

jeffra merged 6ae756c0 into master 4 years ago

jeffra deleted the jeffra/z1-defaults branch 4 years ago

Reviewers

tjruwase

samyam

awan-10

cli99

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed [zero-1] ignore overlap/contiguous_gradients flags #1246 Merged

[zero-1] ignore overlap/contiguous_gradients flags #1246

DeepSpeed
[zero-1] ignore overlap/contiguous_gradients flags
#1246

Merged