transformers
7983bca6 - [`tokenizers`] update `tokenizers` version pin (#27494)

Commit
2 years ago
[`tokenizers`] update `tokenizers` version pin (#27494) * update `tokenizers` version pin * force tokenizers>=0.15 * use 0.14 Co-authored-by: Lysandre <lysandre@huggingface.co> --------- Co-authored-by: Lysandre <lysandre@huggingface.co>
Author
Committer
Parents
Loading