llama.cpp
chat : refactor API
#30210
Merged

chat : refactor API #30210

aldehir merged 21 commits into ggml-org:master from aldehir:chat-refactoring
aldehir
aldehir chat : detect template kind and run the differential analysis once at…
30d3b0ba
aldehir server,chat : implement chat session type
aabb95e9
aldehir server: move vocab to first parameter in chat params parse
cabe7b4e
aldehir server : remove optional chat session
25ef200f
aldehir chat : start a chat session with the assistant role
846b0718
aldehir tests : drive the test-chat streaming cases through common_chat_session
b465765a
aldehir chat : do not copy the parser arena on every parse
d5d35dbc
aldehir tests : compare tool call arguments before renormalizing them in test…
2b9a9ae6
aldehir tests : use one peg_tester per template in test-chat
70925401
aldehir tests : stream test-chat cases in simple_tokenize pieces instead of p…
62cc6d2c
aldehir chat : hold the template analysis in a unique_ptr
0e682ffa
aldehir chat : assign parsers to data.parser directly
febcf026
aldehir tests : define simple_tokenize in test-chat
2c45ada7
aldehir chat,server : resolve chat sampling in the session and stop exposing …
1bc5ba49
aldehir cont : cleanup
2e73dc5d
aldehir cont : cleanup
8b3c7541
aldehir tests : defer test-chat speedups
4fa27e56
aldehir tests : check the session prompt by substring
d1ba6bbf
aldehir cont : clean up
68b05282
aldehir common : remove peg parser serialization
e4bd1b5e
aldehir aldehir requested a review 8 days ago
aldehir aldehir requested a review from pwilkin pwilkin 8 days ago
aldehir aldehir requested a review from ggerganov ggerganov 8 days ago
aldehir aldehir requested a review 8 days ago
github-actions github-actions added documentation
github-actions github-actions added testing
github-actions github-actions added server
pwilkin
pwilkin approved these changes on 2026-10-09
pwilkin
ggml-gh-bot
ServeurpersoCom
ServeurpersoCom
ServeurpersoCom approved these changes on 2026-10-09
aldehir cont : clean up
3c898a27
aldehir
ggerganov
ggerganov approved these changes on 2026-10-09
ngxson
ngxson approved these changes on 2026-10-09
aldehir aldehir merged 8b543610 into master 7 days ago
yshui

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone