DeepSpeed
stage_1_and_2.py: do gradient scale only for fp16
#3166
Merged
Overview
Commits
10
Changes
View On GitHub

stage_1_and_2.py: do gradient scale only for fp16 #3166

tjruwase merged 10 commits into deepspeedai:master from guoyejun:fp16_gscale
guoyejun
guoyejun stage_1_and_2.py: do gradient scale only for fp16
4070c4d7
guoyejun guoyejun requested a review from jeffra jeffra 2 years ago
guoyejun guoyejun requested a review from tjruwase tjruwase 2 years ago
guoyejun guoyejun requested a review from samyam samyam 2 years ago
guoyejun guoyejun requested a review from mrwyattii mrwyattii 2 years ago
guoyejun
tjruwase
tjruwase approved these changes on 2023-04-10
guoyejun Merge branch 'master' into fp16_gscale
72b83ec4
guoyejun Merge branch 'master' into fp16_gscale
6fa91aad
tjruwase Merge branch 'master' into fp16_gscale
996381ca
tjruwase Merge branch 'master' into fp16_gscale
d081c970
guoyejun Merge branch 'master' into fp16_gscale
9cc24d99
tjruwase Merge branch 'master' into fp16_gscale
7d0d90e9
tjruwase tjruwase enabled auto-merge (squash) 2 years ago
tjruwase Merge branch 'master' into fp16_gscale
dbf1ab45
tjruwase Merge branch 'master' into fp16_gscale
acb5578d
tjruwase Merge branch 'master' into fp16_gscale
cf56ae65
tjruwase tjruwase merged 0e357666 into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum