PR #1780 Optimizer state for only trainable parameters

Optimizer state for only trainable parameters #1780

tjruwase merged 8 commits into master from olruwase/zero2_trainable_parameters

Track only trainable parameters

b129b3d0

tjruwase requested a review from

jeffra 3 years ago

tjruwase requested a review from

samyam 3 years ago

tjruwase requested a review from

ShadenSmith 3 years ago

tjruwase requested a review from

conglongli 3 years ago

tjruwase requested a review from

awan-10 3 years ago

tjruwase requested a review from

cli99 3 years ago

tjruwase requested a review from

eltonzheng 3 years ago

tjruwase requested a review from

minjiaz 3 years ago

tjruwase requested a review from

RezaYazdaniAminabadi 3 years ago

Merge branch 'master' into olruwase/zero2_trainable_parameters

1efe252d

Merge branch 'master' into olruwase/zero2_trainable_parameters

d4ddba41

Merge branch 'master' into olruwase/zero2_trainable_parameters

bc8f51ae

Merge branch 'master' into olruwase/zero2_trainable_parameters

842ade76

Merge branch 'master' into olruwase/zero2_trainable_parameters

73e0e22a

Merge branch 'master' into olruwase/zero2_trainable_parameters

4fb83517

Merge branch 'master' into olruwase/zero2_trainable_parameters

ce851db2

jeffra approved these changes on 2022-03-17

tjruwase merged b84edef2 into master 3 years ago

Reviewers

jeffra

samyam

ShadenSmith

conglongli

awan-10

cli99

eltonzheng

minjiaz

RezaYazdaniAminabadi

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Optimizer state for only trainable parameters #1780 Merged

Optimizer state for only trainable parameters #1780

DeepSpeed
Optimizer state for only trainable parameters
#1780

Merged