llama.cpp

dff15d4a - server: (router) add LRU scheduler (#26572)

server: (router) add LRU scheduler (#26572) * add lru_sched * handle coalescing (req leaves waiting queue) * add tests * fix stream case * address review comments