onnxruntime
67ac6ae4
- Tune fast Gelu to use exp(x) instead of tanh(x) on Rocm platform (#6174)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
5 years ago
Tune fast Gelu to use exp(x) instead of tanh(x) on Rocm platform (#6174) * tune fast gelu to use exp(x) instead of tanh(x) on rocm * update to use expression 2/(1+exp(-2x))-1 for stability
References
#6174 - Tune fast Gelu to use exp(x) instead of tanh(x) on Rocm platform
Author
Suffian Khan
Parents
53307a5f
Loading