llama.cpp
05bbba9f - `tool-call`: only match json eagerly for Llama 3.2

Commit

1 year ago

`tool-call`: only match json eagerly for Llama 3.2

References

#9639 - Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars

Author

ochafik

Parents

Loading