DeepSpeed
contiguous gradients should be set to True by default
#1199

Merged

contiguous gradients should be set to True by default #1199

tjruwase merged 2 commits into master from samyamr/contiguous_gradients

contiguous gradients should be set to True by default

e16226f6

samyam requested a review from

awan-10 4 years ago

samyam requested a review from

cli99 4 years ago

samyam requested a review from

conglongli 4 years ago

samyam requested a review from

eltonzheng 4 years ago

samyam requested a review from

jeffra 4 years ago

samyam requested a review from

minjiaz 4 years ago

samyam requested a review from

niumanar 4 years ago

samyam requested a review from

RezaYazdaniAminabadi 4 years ago

samyam requested a review from

ShadenSmith 4 years ago

samyam requested a review from

tjruwase 4 years ago

Set contiguous gradients to True by default

4ea3155e

tjruwase approved these changes on 2021-07-01

tjruwase merged c9fee821 into master 4 years ago

mrwyattii deleted the samyamr/contiguous_gradients branch 2 years ago

Reviewers

tjruwase

awan-10

cli99

conglongli

eltonzheng

jeffra

minjiaz

niumanar

RezaYazdaniAminabadi

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed contiguous gradients should be set to True by default #1199 Merged

contiguous gradients should be set to True by default #1199

DeepSpeed
contiguous gradients should be set to True by default
#1199

Merged