llama.cpp
67709552 - tool-call: compact json output to cap # tokens generated

Commit

1 year ago

tool-call: compact json output to cap # tokens generated

References

#9639 - Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars

Author

ochafik

Parents

Loading