onnxruntime
Tune fast Gelu to use exp(x) instead of tanh(x) on Rocm platform
#6174

Merged

Tune fast Gelu to use exp(x) instead of tanh(x) on Rocm platform #6174

suffiank merged 2 commits into master from sukha/tunegelu

tune fast gelu to use exp(x) instead of tanh(x) on rocm

14c55cec

suffiank requested a review 5 years ago

update to use expression 2/(1+exp(-2x))-1 for stability

1464d11e

weixingzhang approved these changes on 2020-12-21

suffiank merged 67ac6ae4 into master 5 years ago

suffiank deleted the sukha/tunegelu branch 5 years ago

Reviewers

weixingzhang

Assignees

No one assigned

Labels

None yet

Milestone

No milestone