transformers

8e5f76f5 - Upgrading to tokenizers 0.19.0 (#30289)

Upgrading to tokenizers 0.19.0 (#30289) * [DO NOT MERGE] Testing tokenizers 0.19.0rc0 * Accounting for the breaking change. * Ruff. * Upgrading to tokenizers `0.19` (new release with preprend_scheme fixed and new surface for BPE tiktoken bug).