transformers

464d986b - Add missing Flaubert tokenizer tests (#30492)

Add missing Flaubert tokenizer tests (#30492) * add flaubert tokenization test, enrich inheritance in FlaubertTokenizer. * fix quality code ci * ensure parameter consistency * fix ci * fix copyright year and flatten vocab list. * fix style