DeepSpeed
stage3.py: do not scale if gradient_predivide_factor is 1.0
#3630

Merged

stage3.py: do not scale if gradient_predivide_factor is 1.0 #3630

tjruwase merged 2 commits into deepspeedai:master from guoyejun:noscalefor1.0

stage3.py: do not scale if gradient_predivide_factor is 1.0

acbd6701

guoyejun requested a review from

jeffra 2 years ago

guoyejun requested a review from

tjruwase 2 years ago

guoyejun requested a review from

samyam 2 years ago

guoyejun requested a review from

mrwyattii 2 years ago

tjruwase approved these changes on 2023-05-30

Merge branch 'master' into noscalefor1.0

4a4c6b9b

tjruwase merged 52907a66 into master 2 years ago

Reviewers

tjruwase

jeffra

samyam

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone