transformers
ebfd7229 - Let inputs of fast tokenizers be tuples as well as lists (#19898)

Commit

3 years ago

Let inputs of fast tokenizers be tuples as well as lists (#19898) * Let inputs of fast tokenizers be tuples as well as lists * Update src/transformers/tokenization_utils_fast.py Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr> * Style Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>

References

#19449 - [WIP] Fix weights initialization of several vision models

#19898 - Let inputs of fast tokenizers be tuples as well as lists

#27720 - Add common processor tests

#29969 - [SigLIP] Add fast tokenizer

#32831 - [Docs] Update resources

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone