openvino_tokenizers
2368834b
- Update Tokenizer Caching (#83)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Update Tokenizer Caching (#83) * Add Model Caching To Sentencepiece evaluate * Rewrite caching for Wordpiece and Regex Ops * Rewrite caching for BPE
References
#83 - Update Tokenizer Caching
Author
apaniukov
Parents
2add926d
Loading