transformers
09b2de6e
- [`CodeLlamaTokenizerFast`] Fix fix `set_infilling_processor` to properly reset (#26041)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
[`CodeLlamaTokenizerFast`] Fix fix `set_infilling_processor` to properly reset (#26041) * fix `set_infilling_processor` to properly reset * Add docstring! * fixups * more details in the docuemtation about the tokenization * styl;e
References
#26041 - [`CodeLlamaTokenizerFast`] Fix fix `set_infilling_processor` to properly reset
Author
ArthurZucker
Parents
d5360603
Loading