DeepSpeed
f30a0308 - [fp16] lower initial_scale_power (#2663)

Commit

2 years ago

[fp16] lower initial_scale_power (#2663) Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>

References

Author

stas00

Parents