llama.cpp
server + ui: SSE Replay Buffer
#23226
Merged

server + ui: SSE Replay Buffer #23226

ServeurpersoCom
ServeurpersoCom ServeurpersoCom requested a review 189 days ago
ServeurpersoCom ServeurpersoCom requested a review 189 days ago
ServeurpersoCom ServeurpersoCom marked this pull request as draft 189 days ago
coder543
ServeurpersoCom
allozaur allozaur changed the title Sse replay buffer server + ui: SSE Replay Buffer 188 days ago
ngxson
ngxson commented on 2026-05-17
github-actions github-actions added examples
github-actions github-actions added server
github-actions github-actions added server/ui
ServeurpersoCom ServeurpersoCom force pushed 188 days ago
ServeurpersoCom
ServeurpersoCom ServeurpersoCom force pushed 188 days ago
ServeurpersoCom
ServeurpersoCom ServeurpersoCom force pushed 188 days ago
ServeurpersoCom
coder543
coder543 commented on 2026-05-18
coder543
coder543 commented on 2026-05-18
ServeurpersoCom
ServeurpersoCom ServeurpersoCom marked this pull request as ready for review 187 days ago
ServeurpersoCom
coder543
ServeurpersoCom
ServeurpersoCom
ServeurpersoCom ServeurpersoCom force pushed to 3aa3752d 187 days ago
ngxson
ngxson commented on 2026-05-19
ngxson
ngxson commented on 2026-05-19
ngxson
ngxson commented on 2026-05-19
ngxson
ngxson commented on 2026-05-20
ngxson
ngxson commented on 2026-05-20
ngxson
ngxson commented on 2026-05-20
ServeurpersoCom ServeurpersoCom force pushed 186 days ago
ServeurpersoCom
ServeurpersoCom
allozaur
ServeurpersoCom
ServeurpersoCom ServeurpersoCom force pushed 186 days ago
ServeurpersoCom
ngxson
ngxson commented on 2026-05-21
ngxson
ngxson commented on 2026-05-21
allozaur
ServeurpersoCom
allozaur
ServeurpersoCom ServeurpersoCom force pushed to d3fa062f 184 days ago
ServeurpersoCom
ngxson
ngxson commented on 2026-05-23
allozaur
allozaur commented on 2026-05-23
ServeurpersoCom
ServeurpersoCom ServeurpersoCom force pushed from c30469da 180 days ago
ServeurpersoCom
ngxson
ngxson approved these changes on 2026-05-26
ServeurpersoCom ServeurpersoCom force pushed 178 days ago
ServeurpersoCom
allozaur
ServeurpersoCom ServeurpersoCom force pushed 173 days ago
ServeurpersoCom
ServeurpersoCom ServeurpersoCom force pushed 167 days ago
ServeurpersoCom
ServeurpersoCom
allozaur
allozaur requested changes on 2026-05-25
ServeurpersoCom ServeurpersoCom force pushed 157 days ago
ServeurpersoCom
ServeurpersoCom server: SSE replay buffer, survives client disconnect
0c739d90
ServeurpersoCom server: create stream session only after post_tasks succeeds
adff9a58
ServeurpersoCom server, ui: drop X-Stream-Resume, X-Conversation-Id alone enables the…
026b654c
ServeurpersoCom server: drop magic 17, derive the X-Conversation-Id header length fro…
2b1b3b70
ServeurpersoCom refactor: address review feedback from ngxson
00dd0816
ServeurpersoCom server-context: cleaning
ee592f26
ServeurpersoCom server-stream: fix use-after-free on rd
c5db9f6a
ServeurpersoCom ui: fix cross-conversation contamination
5e4ea043
ServeurpersoCom server-http: keep request alive in detached SSE drain
14daa7f5
ServeurpersoCom ui: address review feedback from coder543
4e7c3a2d
ServeurpersoCom format
13eaa777
ServeurpersoCom ui: remove unused selectedModelName
d8e33002
ServeurpersoCom server-stream: poll session->is_cancelled() in stream_aware_should_stop
316c1d30
ServeurpersoCom server-stream, ui: replace GET /v1/streams with POST /v1/streams/lookup
44825432
ServeurpersoCom ui: read conv ids from IndexedDB in syncRemoteRunningStreams
fd5c81a9
ServeurpersoCom server-models: deduplicate stream lookup timeouts behind one constant
54be28f3
ServeurpersoCom ui: extract visibility kick grace into a stream constant, bump to 100…
a61cf961
ngxson make it safer & more simple
81c394f8
ServeurpersoCom server-stream: survive client disconnect via stream_pipe::finish_prod…
cc90c081
ServeurpersoCom server-stream: drain disconnected streams on a manager owned thread
1b4d9a82
ServeurpersoCom ui: add missing JSDoc
4a5cbac5
ServeurpersoCom server-stream: drain on the http worker, drop the manager thread
cffee543
ServeurpersoCom server-stream: split stream_pipe into producer and consumer classes
231e3a0e
ServeurpersoCom server-stream: rename producer methods to unix pipe semantics
4524ea7c
ServeurpersoCom server, ui: route resumable streams via a conv map, persist resume id…
52884f18
ServeurpersoCom ui: resolve continue target by id to stop cross-conversation flash on…
eeb62ddc
ServeurpersoCom ui: skip stream resume when the abort is intentional
c572968c
ServeurpersoCom server: move the conv id to model map into a self contained tracker
374ddbf1
ServeurpersoCom ui: replace stream magic values with enums and shared constants
8667f14d
ServeurpersoCom ui: fold the stream resume and discovery helpers into ChatService
d5c85aac
ServeurpersoCom docs: document the SSE replay buffer in server README-dev
7962c303
ServeurpersoCom ui: align attachServerStream call with onCompletionId param in handle…
99f8ae01
ServeurpersoCom server-http: rename del_ to del to match get and post
2f4be74e
ServeurpersoCom ui: address review feedback from allozaur
5a3a9817
ServeurpersoCom ServeurpersoCom force pushed to 5a3a9817 150 days ago
ServeurpersoCom ui: drop duplicate SSE constants, keep sse.ts canonical
9ddbaf8d
allozaur
allozaur requested changes on 2026-06-25
ServeurpersoCom ui: use svelte:document for the visibilitychange listener
6eaafab3
ngxson
ngxson commented on 2026-06-25
ServeurpersoCom server: trim redundant stream drain comments
ac02404e
ServeurpersoCom server: balance and clean up stream comments
8b591a5e
ServeurpersoCom ui: balance and clean up stream comments
d346f8cb
allozaur
allozaur approved these changes on 2026-06-25
ServeurpersoCom ServeurpersoCom merged 1a87dcdc into master 149 days ago
ggerganov
ggerganov commented on 2026-06-26

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone