transformers
aa4198a2 - [`T5Tokenizer`] Fix fast and extra tokens (#27085)

Commit

2 years ago

[`T5Tokenizer`] Fix fast and extra tokens (#27085) * v4.35.dev.0 * nit t5fast match t5 slow

References

Author

ArthurZucker

Parents