llama.cpp
42f6a58f - chat : trigger lazy grammar on bare JSON tool calls (#32497)

Commit
7 hours ago
chat : trigger lazy grammar on bare JSON tool calls (#32497) Models like Llama 3.x emit tool calls as plain {"name": ...} JSON without a start marker, so with tool_choice=auto no grammar was produced at all. Use a pattern trigger on the opening of the call object instead. Assisted-by: Claude Code
Parents
Loading