flax
e6379c1b
- option of forcing the input of softmax to be fp32 for better numerical stability in mixed-precision training.
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
option of forcing the input of softmax to be fp32 for better numerical stability in mixed-precision training. PiperOrigin-RevId: 627815531
References
#3874 - option of forcing the input of softmax to be fp32 for better numerical stability in mixed-precision training.
Author
a-googler
Committer
a-googler
Parents
034b4aad
Loading