Add GeLU10 (clipped version of GeLU) to transformers to improve quant…
472e8cfa
Add unittests.
9dca4d7d
Import tensorflow after `is_tf_available` check.
50f5b88e
Fix tensorflow wrong function `tf.tensor` to `tf.constant`
b83ec8e9
style.
054db1bf
use `tf.math.max`
632c0f73
Fix tf tests.
d9a0b737
style.
2bdfc0c9
style style style style style style
31de348e
style style style style style style
aee696b4
sgugger
approved these changes
on 2022-02-21
Address @sgugger comments.
20b968e7
Fix wrong operator for raising ValueError for ClippedGELUActivation.
e5eaa242
mfuntowicz
merged
32295b15
into master 4 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub