transformers.js
9a42cf32
- Add support for new `tokenizers>=0.2.0` BPE serialization format
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Add support for new `tokenizers>=0.2.0` BPE serialization format
References
#545 - 🚀🚀🚀 Transformers.js V3 🚀🚀🚀
Author
xenova
Parents
f41e995b
Loading