llama.cpp
server: improve user message detection and create checkpoints at every user message
#24176
Merged
Merged
server: improve user message detection and create checkpoints at every user message #24176
ggerganov
merged
12 commits into
ggml-org:master
from
aldehir:improve-messages-spans
server : improve message span logic
63a1de16
cont : cast size_t to int32_t in comparisons
d26756c3
server : create checkpoints before every user msg
09694226
chat : remove \n in gemma4 delimiters
30a1c4c1
chat : merge msg delimiter structs into one
d9e4f9b5
cont : reword comment
9367e2e5
cont : initialize tokens in delimiter
f72e7f4f
cont : add server_tokens::get_raw_tokens() for mtmd
5e946f33
cont : move message finding to server_tokens and skip mtmd tokens
504d8a2f
cont : update cohere2moe parser
fd324b1e
cont : increase min-step to 8192 and always produce a chkpt for last …
93f97007
cont : merge master
a9dbcf5a
ggerganov
approved these changes
on 2026-06-21
Login to write a write a comment.
Login via GitHub