transformers
8f5d62fd - Fix `bad_words_ids` not working with sentencepiece-based tokenizers (#15343)

Commit

4 years ago

Fix `bad_words_ids` not working with sentencepiece-based tokenizers (#15343) * Fix `bad_word_ids` not working with sentencepiece-based tokenizers * make style Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

References

#15343 - Fix `bad_words_ids` not working with sentencepiece-based tokenizers

#29969 - [SigLIP] Add fast tokenizer

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#62 - Add initial DEIMv2 model implementation

#65 - Fix RTDetrV2 sine position embedding ordering

#71 - Use Mask2Former ignore_value in mask matching and losses

#45110 - Add SAM 3.1

Author

ngoquanghuy99

Parents

06107541

transformers 8f5d62fd - Fix `bad_words_ids` not working with sentencepiece-based tokenizers (#15343)

transformers
8f5d62fd - Fix `bad_words_ids` not working with sentencepiece-based tokenizers (#15343)