onnxruntime
b14d3f1d
- Zhijxu/fix softmax fp16 (#20059)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Zhijxu/fix softmax fp16 (#20059) in fp16 input, the softmax will return nan in some case, the reason is because in float16 dtype, std::numeric_limits<float16>::infinity() will return 0 instead of inf
References
#20059 - Zhijxu/fix softmax fp16
Author
zhijxu-MS
Parents
512c8035
Loading