llama.cpp
d52d7819 - server: concurrency fix + monitoring - add /metrics prometheus compatible endpoint (#5708)

Commit
1 year ago
server: concurrency fix + monitoring - add /metrics prometheus compatible endpoint (#5708) * server: monitoring - add /metrics prometheus compatible endpoint * server: concurrency issue, when 2 task are waiting for results, only one call thread is notified * server: metrics - move to a dedicated struct
Author
Parents
Loading