transformers
04af4b90 - Fix Falcon tokenizer loading in pipeline (#27316)

Commit

2 years ago

Fix Falcon tokenizer loading in pipeline (#27316) * Improve pipeline tokenizer loading and hope nothing breaks * Let's try a hacky solution * Revert the changes to init * Add a falcon hack to the automapping * Add a falcon hack to the automapping

References

#27316 - Fix Falcon tokenizer loading in pipeline

#27720 - Add common processor tests

#29969 - [SigLIP] Add fast tokenizer

#32831 - [Docs] Update resources

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#62 - Add initial DEIMv2 model implementation

#65 - Fix RTDetrV2 sine position embedding ordering

Author

Rocketknight1

Parents

1af766e1

transformers 04af4b90 - Fix Falcon tokenizer loading in pipeline (#27316)

transformers
04af4b90 - Fix Falcon tokenizer loading in pipeline (#27316)