transformers.js
1a9964fb
- Use ungated version of mistral tokenizer (#718)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Minimap (CTRL+M)
Commit
1 year ago
Use ungated version of mistral tokenizer (#718)
References
#718 - Use ungated version of mistral tokenizer
Author
xenova
Parents
992f643e
Files
3
src
tokenizers.js
tests
generate_tests.py
tokenizers.test.js
Loading