transformers

607d24dd - GemmaTokenizer: remove redundant whitespace pre-tokenizer (#43106)

GemmaTokenizer: remove redundant whitespace pre-tokenizer (#43106) * 43062: fixed redundant gemma pre_tokenizer * 43062: fixed redundant gemma pre_tokenizer * fixing the test for CI * removed the test case * Update src/transformers/models/gemma/tokenization_gemma.py Co-authored-by: Ita Zaporozhets <31893021+itazap@users.noreply.github.com> --------- Co-authored-by: Ita Zaporozhets <31893021+itazap@users.noreply.github.com>