llama.cpp

575b6dcc - openai tools: TS signatures work well too at a fraction of the eval cost