llama.cpp
server: monitoring - add /metrics prometheus compatible endpoint
#5708

Merged

server: monitoring - add /metrics prometheus compatible endpoint #5708

phymbert merged 3 commits into ggml-org:master from phymbert:feature/server-metrics-exporter

server: monitoring - add /metrics prometheus compatible endpoint

b8322be5

phymbert requested a review from

ngxson 1 year ago

phymbert requested a review from

ggerganov 1 year ago

ggerganov approved these changes on 2024-02-25

ngxson commented on 2024-02-25

server: concurrency issue, when 2 task are waiting for results, only …

7b29648d

phymbert commented on 2024-02-25

server: metrics - move to a dedicated struct

542f42a6

phymbert requested a review from

ngxson 1 year ago

phymbert merged d52d7819 into master 1 year ago

phymbert deleted the feature/server-metrics-exporter branch 1 year ago

Reviewers

ggerganov

ngxson

Assignees

No one assigned

Labels

None yet

Milestone

No milestone