llama.cpp
821f0a27 - server : defer tasks when "slot unavailable" (#5018)

Commit
1 year ago
server : defer tasks when "slot unavailable" (#5018) * server: defer task when no slot is available * remove unnecessary log --------- Co-authored-by: Xuan Son Nguyen <xuanson.nguyen@snowpack.eu>
Author
Parents
Loading