transformers

cd4584e3 - precompiled_charsmap checking before adding to the normalizers' list for XLNetTokenizerFast conversion. (#24618)

precompiled_charsmap checking before adding to the normalizers' list for XLNetTokenizerFast conversion. (#24618) * precompiled_charsmap checking before adding to the normalizers' list. * precompiled_charsmap checking for all Sentencepiece tokenizer models * precompiled_charsmap checking for SPM tokenizer models - correct formatting