llama.cpp
Add the <|tool_call|> formatting to the granite template
#10177
Merged

Add the <|tool_call|> formatting to the granite template #10177

gabe-l-hart
gabe-l-hart286 days ago👍 2

Description

This is a small tweak on top of #10013 (thanks @arch-btw for adding the template originally!) to include the <|tool_call|> tag that should be inserted when the model responds with a role of assistant_tool_call.

gabe-l-hart fix(granite chat): Add the <|tool_call|> formatting to the granite te…
a05f148e
ggerganov
ggerganov approved these changes on 2024-11-05
ggerganov ggerganov merged b8deef0e into master 286 days ago
gabe-l-hart gabe-l-hart deleted the GraniteToolCallTemplate branch 286 days ago
arch-btw
arch-btw285 days ago

Thank you @gabe-l-hart !

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone