transformers
Add Gated-SiLU to T5
#17420
Merged

Add Gated-SiLU to T5 #17420

DanielHesslow
HuggingFaceDocBuilderDev
patrickvonplaten
patrickvonplaten commented on 2022-05-25
patrickvonplaten
patrickvonplaten commented on 2022-05-26
patrickvonplaten
patrickvonplaten commented on 2022-05-26
patrickvonplaten
patrickvonplaten commented on 2022-05-26
patrickvonplaten
patrickvonplaten commented on 2022-05-26
patrickvonplaten
patrickvonplaten commented on 2022-05-26
patrickvonplaten
patrickvonplaten commented on 2022-05-26
patrickvonplaten
patrickvonplaten commented on 2022-05-26
patrickvonplaten
patrickvonplaten commented on 2022-05-26
patrickvonplaten
patrickvonplaten commented on 2022-05-26
patrickvonplaten patrickvonplaten requested a review from patil-suraj patil-suraj 3 years ago
DanielHesslow
patrickvonplaten
patrickvonplaten
DanielHesslow
patrickvonplaten
patrickvonplaten commented on 2022-05-31
patrickvonplaten patrickvonplaten requested a review from sgugger sgugger 3 years ago
patrickvonplaten
patrickvonplaten
patrickvonplaten approved these changes on 2022-05-31
patrickvonplaten
sgugger
sgugger approved these changes on 2022-05-31
DanielHesslow Add gated-silu to t5 architecture to support UL2
a5bdfcac
DanielHesslow Fix error message
b9340089
DanielHesslow formatting
3c213c25
DanielHesslow formatting again
e7fc734c
DanielHesslow refactor
62143366
DanielHesslow fix classnames in _init_weights
b583b23e
DanielHesslow remove is_gated
a5df0eea
DanielHesslow add test
a2bc0b37
DanielHesslow fix test
e032d400
DanielHesslow Try without the test?
b01264c8
DanielHesslow Add back the test.
710eb1ae
DanielHesslow Improve error message.
fe29654d
DanielHesslow DanielHesslow force pushed to fe29654d 3 years ago
DanielHesslow
patrickvonplaten
patrickvonplaten
patrickvonplaten approved these changes on 2022-06-03
patrickvonplaten patrickvonplaten merged 607acd4f into main 3 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone