llama.cpp
3cb203c8 - llama-chat : Do not throw when tool parsing fails (#14012)

Commit
184 days ago
llama-chat : Do not throw when tool parsing fails (#14012) Currently when a model generates output which looks like a tool call, but is invalid an exception is thrown and not handled, causing the cli or llama-server to bail. Instead, handle the chat parser exception and simply return the generated text in such cases. Signed-off-by: Piotr Stankiewicz <piotr.stankiewicz@docker.com>
Author
Piotr
Parents
Loading