llama.cpp
server: (router) add stop-timeout option
#18350
Merged

server: (router) add stop-timeout option #18350

ngxson
ngxson server: (router) add stop-timeout option
88d6e710
ngxson also allow stop while loading
7e61df6e
ngxson add docs
9471e76a
ngxson ngxson requested a review from ServeurpersoCom ServeurpersoCom 59 days ago
ngxson ngxson requested a review from ggerganov ggerganov 59 days ago
ServeurpersoCom
ServeurpersoCom
ServeurpersoCom
ServeurpersoCom
ServeurpersoCom approved these changes on 2025-12-24
github-actions github-actions added examples
github-actions github-actions added server
ngxson
ngxson unload_lru: also wait for unload to complete
0c2dc02a
ServeurpersoCom
ServeurpersoCom
ngxson
ServeurpersoCom ServeurpersoCom merged f5acfb2f into master 59 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone