transformers
bae9b645 - Use ACT2FN to fetch ReLU activation (#16874)

Commit
3 years ago
Use ACT2FN to fetch ReLU activation (#16874) - all activations should be fetched through ACT2FN - it returns ReLU as `nn.Module`, which allows attaching hooks on the activation function and prints it to stdout when `print(model)`
Author
Parents
Loading