llama.cpp
Enable per-conversation loading states to allow having parallel conversations
#16327
Open
Open
Enable per-conversation loading states to allow having parallel conversations #16327
allozaur
wants to merge
7 commits into
ggml-org:master
from
allozaur:16133-parallel-streaming
feat: Enable per-conversation loading states
f3a858c9
chore: update webui build output
17e80c55
Merge remote-tracking branch 'origin/master' into 16133-parallel-stre…
811f8cb7
chore: update webui build output
16dbf548
feat: Track per-conversation streaming stats
faa14eb2
Merge remote-tracking branch 'origin/master' into 16133-parallel-stre…
aee40d91
chore: update webui build output
51646574
Reviewers
No reviews
Assignees
No one assigned
Labels
examples
server
Milestone
No milestone
Login to write a write a comment.
Login via GitHub