llama.cpp
Server: when no slot is available, defer the task instead of returning "slot unavailable"
#5018
Merged
Overview
Commits
2
Changes
View On GitHub

Server: when no slot is available, defer the task instead of returning "slot unavailable" #5018

ggerganov merged 2 commits into ggml-org:master from ngxson:xsn/defer-server-task
ngxson
server: defer task when no slot is available
bf0daf49
remove unnecessary log
558cd1d6
lemmi
ngxson
ggerganov
ggerganov approved these changes on 2024-01-18
ggerganov ggerganov merged 821f0a27 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum