llama.cpp
00c94083 - server: (refactor) implement generator-based API for task results (#17174)

Commit
30 days ago
server: (refactor) implement generator-based API for task results (#17174) * server: (refactor) implement generator-based API for task results * improve * moving some code * fix "Response ended prematurely" * add sink.done before return false * rm redundant check * rm unused var * rename generator --> reader
Author
Parents
Loading