llama.cpp
vocab : add byte token handling to BPE detokenizer for Gemma4
#21488

Merged

vocab : add byte token handling to BPE detokenizer for Gemma4 #21488

aldehir merged 1 commit into ggml-org:master from aldehir:gemma4-detokenizer

vocab : add byte token handling to BPE detokenizer for Gemma4

b6ce1184

aldehir requested a review from

CISC 5 days ago

CISC approved these changes on 2026-04-05

CISC requested a review from

ggerganov 5 days ago

ggerganov approved these changes on 2026-04-06

aldehir merged 4aa962e2 into master 4 days ago

Reviewers

ggerganov

CISC

Assignees

No one assigned

Labels

None yet

Milestone

No milestone