transformers
2550b41a
- Tokenizer fast save (#11234)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
Tokenizer fast save (#11234) * Save fast tokenizers in both formats * Fix for HerBERT * Proper fix * Properly test new behavior
References
#11234 - Tokenizer fast save
Author
sgugger
Parents
6e1ee47b
Loading