transformers
bae9b645 - Use ACT2FN to fetch ReLU activation (#16874)

Commit

3 years ago

Use ACT2FN to fetch ReLU activation (#16874) - all activations should be fetched through ACT2FN - it returns ReLU as `nn.Module`, which allows attaching hooks on the activation function and prints it to stdout when `print(model)`

References

#16874 - Use ACT2FN to fetch ReLU activation in the T5 model

#19449 - [WIP] Fix weights initialization of several vision models

#27720 - Add common processor tests

#29969 - [SigLIP] Add fast tokenizer

#32831 - [Docs] Update resources

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone

#62 - Add initial DEIMv2 model implementation

Author

eldarkurtic

Parents

cb555af2

transformers bae9b645 - Use ACT2FN to fetch ReLU activation (#16874)

transformers
bae9b645 - Use ACT2FN to fetch ReLU activation (#16874)