llama.cpp
server: (refactor) implement generator-based API for task results
#17174

Merged

server: (refactor) implement generator-based API for task results #17174

ngxson merged 9 commits into ggml-org:master from ngxson:xsn/server_response_generator_refactor

server: (refactor) implement generator-based API for task results

dfa24004

improve

88277d80

moving some code

440ce931

fix "Response ended prematurely"

993440ea

add sink.done before return false

cc2e3977

ngxson requested a review from

ggerganov 35 days ago

github-actions added examples

github-actions added server

rm redundant check

31b8b700

ngxson commented on 2025-11-11

rm unused var

efd73cf1

Merge branch 'master' into xsn/server_response_generator_refactor

f3bdded9

rename generator --> reader

bfa5a70c

ggerganov approved these changes on 2025-11-12

ggerganov commented on 2025-11-12

ngxson merged 00c94083 into master 34 days ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

examples server

Milestone

No milestone