[NAT, DiNAT] Add backbone class (#20654)

Commit

3 years ago

[NAT, DiNAT] Add backbone class (#20654) * Add first draft * Add out_features attribute to config * Add corresponding test * Add Dinat backbone * Add BackboneMixin * Add Backbone mixin, improve tests * Fix embeddings * Fix bug * Improve backbones * Fix Nat backbone tests * Fix Dinat backbone tests * Apply suggestions Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>

References

#20654 - [NAT, DiNAT] Add backbone class

#27720 - Add common processor tests

#29969 - [SigLIP] Add fast tokenizer

#32831 - [Docs] Update resources

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone

#62 - Add initial DEIMv2 model implementation

Author

NielsRogge

Parents

30d8919a

transformers 6ef42587 - [NAT, DiNAT] Add backbone class (#20654)

transformers
6ef42587 - [NAT, DiNAT] Add backbone class (#20654)