transformers
d9378690
- add support for loading a pretrainedfast tokenizer if fast=true and tokenizer.json file exists
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
add support for loading a pretrainedfast tokenizer if fast=true and tokenizer.json file exists
References
#33751 - Load a pretrainedfast tokenizer if fast=true and tokenizer.json exists
Author
itazap
Parents
4f29a60b
Loading