Gelu10 #15676

mfuntowicz merged 12 commits into master from gelu10
mfuntowicz
mfuntowicz mfuntowicz requested a review from LysandreJik LysandreJik 4 years ago
mfuntowicz mfuntowicz requested a review from sgugger sgugger 4 years ago
HuggingFaceDocBuilder
LysandreJik
mfuntowicz
LysandreJik
LysandreJik approved these changes on 2022-02-18
sgugger
mfuntowicz
mfuntowicz Add GeLU10 (clipped version of GeLU) to transformers to improve quant…
472e8cfa
mfuntowicz Add unittests.
9dca4d7d
mfuntowicz Import tensorflow after `is_tf_available` check.
50f5b88e
mfuntowicz Fix tensorflow wrong function `tf.tensor` to `tf.constant`
b83ec8e9
mfuntowicz style.
054db1bf
mfuntowicz use `tf.math.max`
632c0f73
mfuntowicz Fix tf tests.
d9a0b737
mfuntowicz style.
2bdfc0c9
mfuntowicz mfuntowicz force pushed to 2bdfc0c9 4 years ago
mfuntowicz style style style style style style
31de348e
mfuntowicz style style style style style style
aee696b4
mfuntowicz
sgugger
sgugger approved these changes on 2022-02-21
mfuntowicz Address @sgugger comments.
20b968e7
mfuntowicz Fix wrong operator for raising ValueError for ClippedGELUActivation.
e5eaa242
mfuntowicz mfuntowicz merged 32295b15 into master 4 years ago
mfuntowicz mfuntowicz deleted the gelu10 branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone