transformers
cc013513
- :zip: #2106 basic tokenizer.tokenize global speed improvement (3-8x) by simply caching added_tokens in a Set
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
6 years ago
:zip: #2106 basic tokenizer.tokenize global speed improvement (3-8x) by simply caching added_tokens in a Set
References
#2177 - :zip: #2106 tokenizer.tokenize speed improvement (3-8x) by caching added_tokens in a Set
Author
Pascal Voitot
Committer
Pascal Voitot
Parents
e92bcb7e
Loading