llama.cpp
`tool-call`: support Command R7B (+ return tool_plan "thoughts" in API)
#11585

Merged

`tool-call`: support Command R7B (+ return tool_plan "thoughts" in API) #11585

ochafik merged 7 commits into ggml-org:master from ochafik:command-r7b

`tool-call`: Command R7B (w/ tool_plan return), preserved_tokens & te…

e44a8eb7

github-actions added testing

github-actions added examples

github-actions added server

fix test-chat

548ac5a4

rm msg.thoughts (that's for later / R1)

a28d9bef

use set::find

5fd28b3a

ochafik marked this pull request as ready for review 329 days ago

ochafik requested a review from

ngxson 329 days ago

ggerganov approved these changes on 2025-02-02

comment / warn about preserved tokens not being single tokens

3a37ae40

make multi token not preserved warning more actionable

a278637f

bump multi token not preserved log to warning

4a5b6540

ochafik merged bfcce4d6 into master 329 days ago

ochafik deleted the command-r7b branch 329 days ago

Reviewers

ggerganov

ngxson

Assignees

No one assigned

Labels

testing examples server

Milestone

No milestone