llama.cpp

server: add router device memory margin parameter for dynamic unloading

#21231

Open