PR #414 Linear warmup+decay lr schedule

Linear warmup+decay lr schedule #414

tjruwase merged 1 commit into master from olruwase/lr_warmup_decay

Add Linear warmup+decay lr schedule

50ca3888

tjruwase requested a review from

ShadenSmith 6 years ago

tjruwase requested a review from

jeffra 6 years ago

tjruwase requested a review from

cli99 6 years ago

tjruwase requested a review from

arashashari 6 years ago

tjruwase requested a review from

awan-10 6 years ago

tjruwase requested a review from

conglongli 6 years ago

tjruwase requested a review from

eltonzheng 6 years ago

tjruwase requested a review from

minjiaz 6 years ago

tjruwase requested a review from

niumanar 6 years ago

tjruwase requested a review from

RezaYazdaniAminabadi 6 years ago

tjruwase requested a review from

samyam 6 years ago

tjruwase added enhancement

jeffra approved these changes on 2020-09-16

tjruwase merged 0e942df0 into master 6 years ago

Reviewers

jeffra

ShadenSmith

cli99

arashashari

awan-10

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

Assignees

No one assigned

Labels

enhancement

Milestone

No milestone

DeepSpeed Linear warmup+decay lr schedule #414 Merged

Linear warmup+decay lr schedule #414

DeepSpeed
Linear warmup+decay lr schedule
#414

Merged