llama.cpp

3203ab47 - server : prevent LRU eviction of models still loading

server : prevent LRU eviction of models still loading In router mode with models_max, unload_lru() could select a model in LOADING state as the LRU victim. Because the child's stdin monitoring thread starts only after model loading completes, the exit command sits unread in the buffer and the stop_timeout expires before the child ever receives it, causing a force-kill. LOADING models still count toward capacity to prevent resource exhaustion from concurrent loads, but are excluded from eviction.