llama.cpp
1029ff90
- force printing </tool_call> on hermes 2 model if/as it's a special token
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
force printing </tool_call> on hermes 2 model if/as it's a special token
References
#9639 - Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars
Author
Olivier Chafik
Parents
5add261a
Loading