llama.cpp
821f0a27
- server : defer tasks when "slot unavailable" (#5018)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
server : defer tasks when "slot unavailable" (#5018) * server: defer task when no slot is available * remove unnecessary log --------- Co-authored-by: Xuan Son Nguyen <xuanson.nguyen@snowpack.eu>
References
#5018 - Server: when no slot is available, defer the task instead of returning "slot unavailable"
Author
ngxson
Parents
96d7f56d
Loading