llama.cpp
`tool-call`: allow `--chat-template chatml` w/ `--jinja`, default to chatml upon parsing issue, avoid double bos
#11616

Merged

`tool-call`: allow `--chat-template chatml` w/ `--jinja`, default to chatml upon parsing issue, avoid double bos #11616

ochafik merged 7 commits into ggml-org:master from ochafik:jinja-chatml

tool-call: allow `--jinja --chat-template chatml`

1e9acd2d

Update test_tool_call.py

77ae97e7

github-actions added examples

github-actions added python

github-actions added server

ochafik changed the title ~~`tool-call`: allow `--chat-template chatml` when `--jinja` enabled~~ `tool-call`: allow `--chat-template chatml` w/ `--jinja`, default to chatml upon parsing issue, avoid double bos 219 days ago

fix typo

cf83623a

fix double bos issue (drop bos/eos tokens from jinja template)

5d18d76b

ochafik marked this pull request as ready for review 219 days ago

ochafik requested a review from

ngxson 219 days ago

fix bad merge

aa98e590

add missing try catch around jinja parsing to default to chatml

b2dd4909

Simplify default chatml logic

d73448de

ngxson approved these changes on 2025-02-03

ochafik merged cde38332 into master 218 days ago

Reviewers

ngxson

Assignees

No one assigned

Labels

examples python server

Milestone

No milestone

llama.cpp `tool-call`: allow `--chat-template chatml` w/ `--jinja`, default to chatml upon parsing issue, avoid double bos #11616 Merged

`tool-call`: allow `--chat-template chatml` w/ `--jinja`, default to chatml upon parsing issue, avoid double bos #11616

llama.cpp
`tool-call`: allow `--chat-template chatml` w/ `--jinja`, default to chatml upon parsing issue, avoid double bos
#11616

Merged