transformers
3d1a7bf4 - [`tokenizers`] update `tokenizers` version pin (#27494)

Commit
2 years ago
[`tokenizers`] update `tokenizers` version pin (#27494) * update `tokenizers` version pin * force tokenizers>=0.15 * use 0.14 Co-authored-by: Lysandre <lysandre@huggingface.co> --------- Co-authored-by: Lysandre <lysandre@huggingface.co>
Author
Parents
Loading