llama.cpp
server: improve user message detection and create checkpoints at every user message
#24176
Merged

server: improve user message detection and create checkpoints at every user message #24176

aldehir
github-actions github-actions added testing
github-actions github-actions added examples
github-actions github-actions added server
aldehir
ggerganov ggerganov assigned ggerganov ggerganov 165 days ago
aldehir aldehir force pushed 165 days ago
aldehir server : improve message span logic
63a1de16
aldehir cont : cast size_t to int32_t in comparisons
d26756c3
aldehir server : create checkpoints before every user msg
09694226
aldehir chat : remove \n in gemma4 delimiters
30a1c4c1
aldehir chat : merge msg delimiter structs into one
d9e4f9b5
aldehir cont : reword comment
9367e2e5
aldehir cont : initialize tokens in delimiter
f72e7f4f
aldehir cont : add server_tokens::get_raw_tokens() for mtmd
5e946f33
aldehir cont : move message finding to server_tokens and skip mtmd tokens
504d8a2f
aldehir cont : update cohere2moe parser
fd324b1e
aldehir aldehir force pushed to fd324b1e 155 days ago
aldehir aldehir marked this pull request as ready for review 155 days ago
aldehir aldehir requested a review 155 days ago
aldehir aldehir requested a review from pwilkin pwilkin 155 days ago
aldehir aldehir requested a review 155 days ago
jacekpoplawski
aldehir
ggerganov
ggerganov
aldehir
ggerganov
pwilkin
aldehir cont : increase min-step to 8192 and always produce a chkpt for last …
93f97007
aldehir cont : merge master
a9dbcf5a
aldehir
rankaiyx
ggerganov
ggerganov
ggerganov approved these changes on 2026-06-21
aldehir
ggerganov ggerganov merged 73618f27 into master 148 days ago
patrickzel
patrickzel
aldehir
patrickzel
patrickzel
patrickzel

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone