llama.cpp
b069b10a - vocab: fix Gemma4 tokenizer (#21343)

Commit
6 days ago
vocab: fix Gemma4 tokenizer (#21343) * seems to work * fix case with new line Co-authored-by: sayap <sokann@gmail.com> * gemma 4: fix pre tok regex --------- Co-authored-by: Xuan Son Nguyen <son@huggingface.co> Co-authored-by: sayap <sokann@gmail.com>
Author
Parents
Loading