llama.cpp
server: fix streaming crashes
#13786
Merged

server: fix streaming crashes #13786

ochafik merged 8 commits into ggml-org:master from ochafik:fix-chat-parsers
ochafik
github-actions github-actions added testing
github-actions github-actions added examples
github-actions github-actions added server
ochafik ochafik marked this pull request as ready for review 105 days ago
ochafik ochafik requested a review from ngxson ngxson 105 days ago
teleprint-me
PrideIsLife
ochafik
ochafik add preludes to content on partial regex match
6fd863ef
ochafik allow all parsers to parse non-tool-call content.
6f8c7aa0
ochafik nit spaces
6c3f4040
ochafik Merge remote-tracking branch 'origin/master' into fix-chat-parsers
e064360e
ochafik ochafik force pushed from cfd2f2b9 to e064360e 104 days ago
ochafik
ochafik ochafik requested a review from CISC CISC 104 days ago
pwilkin
CISC
CISC approved these changes on 2025-05-26
ochafik Merge remote-tracking branch 'origin/master' into fix-chat-parsers
cda30912
ochafik ochafik changed the title server: streaming fixes server: fix streaming crashes 104 days ago
ochafik ochafik added bugfix
ochafik apply suggested refactor
5c2d584d
ochafik Merge remote-tracking branch 'origin/master' into fix-chat-parsers
62ae9f54
ochafik tweak order of <|python_tag|> vs <function= parsing for functionary v…
f766fe09
ngxson
ngxson approved these changes on 2025-05-26
ochafik ochafik merged 03f582ae into master 104 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone