transformers
536ea2ac
- [`LlamaSlowConverter`] Slow to Fast better support (#29797)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
[`LlamaSlowConverter`] Slow to Fast better support (#29797) * fix * fix test * style * nit * rather rely on concert token to id * fix quality * Update src/transformers/convert_slow_tokenizer.py
References
#29797 - [`LlamaSlowConverter`] Slow to Fast better support
Author
ArthurZucker
Parents
e2036468
Loading