transformers
[`tokenizers`] Ensure that add_prefix_space is propagated to backend_tokenizer.pre_tokenizer
#35593
Merged

Loading