transformers
fb41f9f5 - Add a special tokenizer for CPM model (#11068)

Commit
4 years ago
Add a special tokenizer for CPM model (#11068) * Add a special tokenizer for CPM model * make style * fix * Add docs * styles * cpm doc * fix ci * fix the overview * add test * make style * typo * Custom tokenizer flag * Add REAMDE.md Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
Author
Parents
Loading