Add the <|tool_call|> formatting to the granite template #10177
fix(granite chat): Add the <|tool_call|> formatting to the granite te…
a05f148e
ggerganov
approved these changes
on 2024-11-05
ggerganov
merged
b8deef0e
into master 286 days ago
gabe-l-hart
deleted the GraniteToolCallTemplate branch 286 days ago
Assignees
No one assigned
Description
This is a small tweak on top of #10013 (thanks @arch-btw for adding the template originally!) to include the
<|tool_call|>
tag that should be inserted when the model responds with a role ofassistant_tool_call
.