llama.cpp
c479d39a - tool-call: allow special tokens that are grammar triggers

Commit

1 year ago

tool-call: allow special tokens that are grammar triggers

References

#9639 - Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars

Author

Olivier Chafik

Parents

Loading