transformers
51d7ebf2 - fix BertTokenizerFast `tokenize_chinese_chars` arg (#15158)

Commit

4 years ago

fix BertTokenizerFast `tokenize_chinese_chars` arg (#15158) * add new test * fix in init * more relevant test

References

#15158 - fix BertTokenizerFast `tokenize_chinese_chars` arg

#29969 - [SigLIP] Add fast tokenizer

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#62 - Add initial DEIMv2 model implementation

#65 - Fix RTDetrV2 sine position embedding ordering

#71 - Use Mask2Former ignore_value in mask matching and losses

#44385 - Fix make check-repo

#45110 - Add SAM 3.1

Author

SaulLu

SaulLu

Parents

Loading