transformers
536ea2ac - [`LlamaSlowConverter`] Slow to Fast better support (#29797)

Commit
1 year ago
[`LlamaSlowConverter`] Slow to Fast better support (#29797) * fix * fix test * style * nit * rather rely on concert token to id * fix quality * Update src/transformers/convert_slow_tokenizer.py
Author
Parents
Loading