transformers
1f62d4ed
- Update ModelType for Unigram tokenizer (#43860)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
17 hours ago
Update ModelType for Unigram tokenizer (#43860) Correct Unigram model type is 1 not 2. https://github.com/google/sentencepiece/blob/master/src/sentencepiece_model.proto#L48-L52
References
#43860 - Update ModelType for Unigram tokenizer
Author
pavel-esir
Parents
33a8e68d
Loading