llama.cpp
15ec01e8 - jinja: only add special tokens if template doesn't seem to handle them

Commit

1 year ago

jinja: only add special tokens if template doesn't seem to handle them

References

#9639 - Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars

Author

ochafik

Parents

Loading