transformers
bae9b645
- Use ACT2FN to fetch ReLU activation (#16874)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 years ago
Use ACT2FN to fetch ReLU activation (#16874) - all activations should be fetched through ACT2FN - it returns ReLU as `nn.Module`, which allows attaching hooks on the activation function and prints it to stdout when `print(model)`
References
#16874 - Use ACT2FN to fetch ReLU activation in the T5 model
Author
eldarkurtic
Parents
cb555af2
Loading