llama.cpp
server : refactor middleware and /health endpoint
#9056

Merged

server : refactor middleware and /health endpoint #9056

ngxson merged 6 commits into ggml-org:master from ngxson:wsn/server_health_non_blocking

server : refactor middleware and /health endpoint

b337a7bf

github-actions added examples

github-actions added server

ngxson requested a review from

ggerganov 1 year ago

move "fail_on_no_slot" to /slots

4af74d81

ggerganov approved these changes on 2024-08-16

Update examples/server/server.cpp

a53a59c8

fix server tests

57d35897

github-actions added python

fix CI

ab3d8ec4

update server docs

a4b63194

ngxson merged 8b3befc0 into master 1 year ago

ngxson added breaking change

Reviewers

ggerganov

Assignees

No one assigned

Labels

breaking change examples python server

Milestone

No milestone