llama.cpp
vocab : keep DNA k-mer ids distinct from colliding BPE tokens
#23466

Merged

vocab : keep DNA k-mer ids distinct from colliding BPE tokens #23466

CISC merged 2 commits into ggml-org:master from kashif:fix-hybriddna-kmer-collision

kashif requested a review from

CISC 104 days ago

kashif force pushed 104 days ago

vocab : mark hybriddna k-mers to avoid BPE token collisions

ed2329cf

kashif force pushed to ed2329cf 104 days ago

improved loop

6cbf9dc4

github-actions added python

CISC approved these changes on 2026-05-21

CISC added merge ready

ServeurpersoCom approved these changes on 2026-05-22

CISC merged afcda09d into master 103 days ago

kashif deleted the fix-hybriddna-kmer-collision branch 103 days ago

Reviewers

ServeurpersoCom

CISC

Assignees

No one assigned

Labels

python merge ready

Milestone

No milestone