DeepSpeed
[fp16] lower `initial_scale_power` to `16`
#2663
Merged

[fp16] lower `initial_scale_power` to `16` #2663

stas00
stas00 [fp16] lower initial_scale_power
5baff035
stas00 stas00 requested a review from jeffra jeffra 2 years ago
stas00 stas00 requested a review from tjruwase tjruwase 2 years ago
stas00 stas00 requested a review from mrwyattii mrwyattii 2 years ago
tjruwase
jeffra
jeffra approved these changes on 2023-01-04
tjruwase Merge branch 'master' into initial_scale_power
22ed7e8a
tjruwase Merge branch 'master' into initial_scale_power
8c81ebea
tjruwase Merge branch 'master' into initial_scale_power
77ec819b
tjruwase tjruwase merged f30a0308 into master 2 years ago
stas00 stas00 deleted the initial_scale_power branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone