transformers
3d1a7bf4
- [`tokenizers`] update `tokenizers` version pin (#27494)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
[`tokenizers`] update `tokenizers` version pin (#27494) * update `tokenizers` version pin * force tokenizers>=0.15 * use 0.14 Co-authored-by: Lysandre <lysandre@huggingface.co> --------- Co-authored-by: Lysandre <lysandre@huggingface.co>
References
#27494 - [`tokenizers`] update `tokenizers` version pin
Author
ArthurZucker
Parents
64e21ca2
Loading