llama.cpp

77918caf - server: allow accessing /metrics and /slots during llama_decode() (#27041)

server: allow accessing /metrics and /slots during llama_decode() (#27041) * server_queue::worker * call llama_decode inside yield_to_queue * also handle process_mtmd_chunk * clean up * nits * rm test