PR #5548 server: enhanced health endpoint

server: enhanced health endpoint #5548

ggerganov merged 2 commits into ggml-org:master from phymbert:feature/server-better-healthcheck

server: enrich health endpoint with available slots, return 503 if no…

fb1c1d0f

server: document new status no slot available in the README.md

ce8fe5d8

ggerganov approved these changes on 2024-02-18

ggerganov merged e75c6279 into master 1 year ago

brittlewis12 commented on 2024-02-18

phymbert deleted the feature/server-better-healthcheck branch 1 year ago

Reviewers

ggerganov

brittlewis12

Assignees

No one assigned

Labels

None yet

Milestone

No milestone