llama.cpp
unicode,test: add Qwen3.5 non-backtracking tokenizer handler and regr…
#22110
Merged
Merged
unicode,test: add Qwen3.5 non-backtracking tokenizer handler and regr… #22110
pwilkin
merged
3 commits into
ggml-org:master
from
Kabir08:fix/qwen35-tokenizer-stack-overflow
unicode,test: add Qwen3.5 non-backtracking tokenizer handler and regr…
686ffbd9
aldehir
requested changes
on 2026-04-25
fix: enhance regex handling for Qwen3.5 tokenizer to include accent m…
a1034033
cont : remove trailing whitespace
4866d83a
aldehir
approved these changes
on 2026-05-14
pwilkin
approved these changes
on 2026-05-14
Login to write a write a comment.
Login via GitHub