llama.cpp
f5acfb2f - server: (router) add stop-timeout option (#18350)

Commit
28 days ago
server: (router) add stop-timeout option (#18350) * server: (router) add stop-timeout option * also allow stop while loading * add docs * unload_lru: also wait for unload to complete
Author
Parents
Loading