llama.cpp
2f0ee84b - server: bench: minor fixes (#10765)

Commit
308 days ago
server: bench: minor fixes (#10765) * server/bench: - support openAI streaming standard output with [DONE]\n\n - export k6 raw results in csv - fix too many tcp idle connection in tcp_wait - add metric time to emit first token * server/bench: - fix when prometheus not started - wait for server to be ready before starting bench
Author
Parents
Loading