transformers.js
8a96319f
- Allow `added_tokens` list to be empty
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Allow `added_tokens` list to be empty
References
#250 - Add M2M100 tokenizer (Closes #235)
Author
xenova
Parents
474a5bf7
Loading
