PR #414 Linear warmup+decay lr schedule

Linear warmup+decay lr schedule #414

tjruwase merged 1 commit into master from olruwase/lr_warmup_decay

Add Linear warmup+decay lr schedule

50ca3888

tjruwase requested a review from

ShadenSmith 5 years ago

tjruwase requested a review from

jeffra 5 years ago

tjruwase requested a review from

cli99 5 years ago

tjruwase requested a review from

arashashari 5 years ago

tjruwase requested a review from

awan-10 5 years ago

tjruwase requested a review from

conglongli 5 years ago

tjruwase requested a review from

eltonzheng 5 years ago

tjruwase requested a review from

minjiaz 5 years ago

tjruwase requested a review from

niumanar 5 years ago

tjruwase requested a review from

RezaYazdaniAminabadi 5 years ago

tjruwase requested a review from

samyam 5 years ago

tjruwase added enhancement

jeffra approved these changes on 2020-09-16

tjruwase merged 0e942df0 into master 5 years ago

Reviewers

jeffra

ShadenSmith

cli99

arashashari

awan-10

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

Assignees

No one assigned

Labels

enhancement

Milestone

No milestone

DeepSpeed Linear warmup+decay lr schedule #414 Merged

Linear warmup+decay lr schedule #414

DeepSpeed
Linear warmup+decay lr schedule
#414

Merged