Go
Home
Pricing
FAQ
Install
Home
Pricing
FAQ
Install
Login
via GitHub
ochafik/llama.cpp
Pull Requests
Commits
tool-call-nits
Telosnex_phi4_tools_template
Telosnex_phi4_tools_template2
add_ass_param
agent-example
agent-example2
agent-example4
agent-example5
agent-example6
agent-example-aug28
agent-example-cpp
agent-example-tmp
agent-example-tmp3
agent-examples6-jinjadev
allow-unclosed-think
bench-tool
bins
c7rb-fix
cache-url
chat-cleanups
chat-parser
ci-ccache
ci-fix-revocation-errors
ci-parallel
ci-write-less-ccache
claude/add-mmap-session-cache-vg6PE
claude/llamafile-build-script-dsKy5
cli
cli-tmp
cmake-b
cmake-b2
compact-bounds
cuda-releases
curl-fixes
date
decimal-bounds
detect-model-format
download
enable-thinking
enable-thinking2
enable-thinking-fix-chat-parsers
fast-quant
fix-chat-parsers
fix-diff-bug
fix-diff-bug2
fix-gen-prompt
fix-jinja-llg
fix-json-whitespace-parsing
fix-partial-regex-alternations
fix-python-tag
fix-qwen-tools
fix-reasoning-diffs
fix-stops
fn-name-delta
force-think
functiongemma-toolcall
generate-assets
generic-thoughts
gguf-read
gguf-read-field
grammar-async
grammar-async3
grammar-copy
grammar-fast
grammar-fast-disable
grammar-fast-linked
grammar-fast-nits
grammar-fast-resampling
grammar-fast-resampling-early
grammar-fast-single
grammar-fast-single2
grammar-from-json-schema
grammar-left-rec
grammar-less-stacks
grammar-rejects
grammar-reps
grammar-reps2
grammar-reps-revert
grammar-resample2
grammar-resampling
grammar-resampling-early
grammar-speedup
grammar-speedup2
grammar-speedup3
grammar-stacks-callbacks
grammar-transitions
grammars-early-exit
grammars-early-exit-resample
grammars-resample
gritlm-url
hip-ccache
install
jf-flag
jinja
jinja-chatml
json_schema
json-additional
json-bounds
json-doc
json-doc3
json-faster-repetitions
json-faster-repetitions2
json-faster-repetitions-bak
json-fixes
json-fixes-cpp
json-fixes-refact
json-integ
json-noadd
json-order
json-order2
json-order3
json-refs
json-refs2
json-schema-file
json-tests
json-type
json-updates
json-ws
kv-tree-cache
lazy-grammar-regex
llama2c-gguf
llama2c-non-shared-weights
llama2c-non-shared-weights-save
llama-lib-rename
lto2
main-json
master
mcp
minja-sync-aug8
minja-sync-minmax
model-args
nit-empty-grammar
ochafik/minja-sync2
offline
opencl-kernels
partial-regex
peg-end-tokens-metadata
peg-migration-complete
peg-migration-complete-history
peg-migration-inline-generic-helper
peg-migration-squashed
peg-migration-squashed-fixes
peg-simplify
quant-lowdisk
quant-lowraw-hack
quant-py
qwen3-chat
r1-toolcall
refector-chat-test
reuse-graphs
reuse-graphs-2
server-cancel
skip-unused
skip-unused-2-save
skip-unused-2
skip-unused-hipblas
stdin-prompt
string_utils
sync-minja-2
sync-minja-5
sync-minja-7
sync-minja-8
sync-minja-reasoning
sync-minja-reasoning-bak
tc-py
test-cli
tmp
tmp-grammar-debug-candidates
tmp-ochafik-masked-training
tmp-ochafik-opencl-clblast
tmp-ochafik-server-py
tmp-opencl-nofp16
token-aware-grammars-impl
tool-bench
tool-bench2
tool-bench-prod
tool-call
tool-call-0
tool-call-1
tool-call-2
tool-call-3
tool-call-bak1
tool-call-caching
tool-call-handler
tool-call-nits
tool-call-simpler
tool-diffs
tool-diffs-bak
tool-diffs-bak2
tool-diffs-bak3
update-functionary-tool-call-doc
url-meta
web-ui-mcp
Tool-call: do last partial parse upon limit stop
Olivier Chafik
committed
1 year ago
2f99236f
Cleanup dead code in llama_3_1 tool call code
Olivier Chafik
committed
1 year ago
6d568290
Allow tool use + streaming
Olivier Chafik
committed
1 year ago
62717145
Fix Llama 3.1 (incl. constrained builtin tools e.g. `<|python_tag|>foo.call(arg=vallue)`)
ochafik
committed
1 year ago
ef9efc9e
Update test-chat-handler.cpp
ochafik
committed
1 year ago
2d607f1a
comment out broken tests in test_tool_call.py
ochafik
committed
1 year ago
b565ab2a
Split e2e test_tool_call from test_chat_completion
ochafik
committed
1 year ago
cafea609
Pass grammar laziness all the way down to sampler (need to print special trigger tokens e.g. for Nemo even w/ tool_choice=required)
ochafik
committed
1 year ago
90effb84
updated tool call example to be less ambiguous (deepseek likes to rant about hello world)
ochafik
committed
1 year ago
ad229783
Rehabilitate test_format_detection
ochafik
committed
1 year ago
fa065eb0
fix test-chat-handler grammar tests
ochafik
committed
1 year ago
add91241
DeepSeek-R1: implement grammar constraints
ochafik
committed
1 year ago
118f799a
Prepare DeepSeek-R1-Distill-Llama-8B support
ochafik
committed
1 year ago
92ac336d
Update test_chat_completion.py
ochafik
committed
1 year ago
09971e62
tool-call: compact json output to cap # tokens generated
ochafik
committed
1 year ago
67709552
tool-call: fix lazy grammar & mixed content + tool calls parsing
ochafik
committed
1 year ago
57f40e36
tool-call: add weather tool e2e tests
ochafik
committed
1 year ago
2efa0c27
jinja: only add special tokens if template doesn't seem to handle them
ochafik
committed
1 year ago
15ec01e8
tool-call: remove nonsensical code_interpreter code
ochafik
committed
1 year ago
da606d8d
tool-call: fix special handling of special trigger tokens (Nemo)
ochafik
committed
1 year ago
bddc1beb
nits
ochafik
committed
1 year ago
ca0c837b
tool-call: fix functionary v3.1 required test
ochafik
committed
1 year ago
f7078cab
reshuffle chat handlers
ochafik
committed
1 year ago
5ec4c5e4
sync: minja
ochafik
committed
1 year ago
43385b2f
Merge branch 'tool-call' into tool-call-handler
ochafik
committed
1 year ago
11594557
nit: trailing spaces
ochafik
committed
1 year ago
3f3fc039
Update test_chat_completion.py
Olivier Chafik
committed
1 year ago
51b7aab8
jinja: don't add bos when jinja enabled
Olivier Chafik
committed
1 year ago
a6463c1e
Update test_chat_completion.py
Olivier Chafik
committed
1 year ago
0208b207
tool-call: allow special tokens that are grammar triggers
Olivier Chafik
committed
1 year ago
c479d39a
Older
