llama.cpp
721354fb - server: (router) move model downloading to dedicated process (#24834)

Commit
1 day ago
server: (router) move model downloading to dedicated process (#24834) * server: real-time model load progress tracking via /models/sse * update docs * server: move model download to child process * rm unused * fix most problems * clean up * nit fixes * fix test case * do not detact() thread * shorter MODEL_DOWNLOAD_TIMEOUT in test * throttle
Author
Parents
Loading