llama.cpp
server + ui: ping silent SSE streams every 1s and kick only after 3s so slow prefill never drops healthy connections
#25241
Merged

server + ui: ping silent SSE streams every 1s and kick only after 3s so slow prefill never drops healthy connections #25241

ServeurpersoCom
ServeurpersoCom server + ui: ping silent SSE streams every 1s and kick only after 3s …
6070a31c
ServeurpersoCom ServeurpersoCom requested a review 143 days ago
ServeurpersoCom ServeurpersoCom requested a review 143 days ago
github-actions github-actions added server/ui
ngxson
ngxson commented on 2026-07-02
ServeurpersoCom server + ui: sse_ping_interval becomes a per-request body field
d72bdbcc
ServeurpersoCom ServeurpersoCom requested a review 142 days ago
github-actions github-actions added documentation
github-actions github-actions added server
ngxson
ngxson commented on 2026-07-02
ServeurpersoCom server: move sse_ping_interval into the request schema
1f95e37d
ngxson
ngxson approved these changes on 2026-07-03
ngxson ngxson merged b5315e16 into master 142 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone