transformers
09b2de6e - [`CodeLlamaTokenizerFast`] Fix fix `set_infilling_processor` to properly reset (#26041)

Commit
2 years ago
[`CodeLlamaTokenizerFast`] Fix fix `set_infilling_processor` to properly reset (#26041) * fix `set_infilling_processor` to properly reset * Add docstring! * fixups * more details in the docuemtation about the tokenization * styl;e
Author
Parents
Loading