transformers
ecfe9be7 - [UDOP] Add special tokens to tokenizer (#29594)

Commit

1 year ago

[UDOP] Add special tokens to tokenizer (#29594) * Add special tokens * Add special tokens * Use fmt * Uncomment code * Add test * Remove scripts * Address comments * Improve tests * Address comment * Remove flag

References

#29594 - [UDOP] Add special tokens to tokenizer

#29969 - [SigLIP] Add fast tokenizer

#32831 - [Docs] Update resources

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone

#62 - Add initial DEIMv2 model implementation

Author

NielsRogge

Parents

d9850abd

transformers ecfe9be7 - [UDOP] Add special tokens to tokenizer (#29594)

transformers
ecfe9be7 - [UDOP] Add special tokens to tokenizer (#29594)