Go
Home
Pricing
FAQ
Install
Home
Pricing
FAQ
Install
Login
via GitHub
ochafik/llama.cpp
Pull Requests
Commits
grammar-speedup2
Telosnex_phi4_tools_template
Telosnex_phi4_tools_template2
add_ass_param
agent-example
agent-example2
agent-example4
agent-example5
agent-example6
agent-example-aug28
agent-example-cpp
agent-example-tmp
agent-example-tmp3
agent-examples6-jinjadev
allow-unclosed-think
bench-tool
bins
c7rb-fix
cache-url
chat-cleanups
chat-parser
ci-ccache
ci-fix-revocation-errors
ci-parallel
ci-write-less-ccache
claude/add-mmap-session-cache-vg6PE
claude/llamafile-build-script-dsKy5
cli
cli-tmp
cmake-b
cmake-b2
compact-bounds
cuda-releases
curl-fixes
date
decimal-bounds
detect-model-format
download
enable-thinking
enable-thinking2
enable-thinking-fix-chat-parsers
fast-quant
fix-chat-parsers
fix-diff-bug
fix-diff-bug2
fix-gen-prompt
fix-jinja-llg
fix-json-whitespace-parsing
fix-partial-regex-alternations
fix-python-tag
fix-qwen-tools
fix-reasoning-diffs
fix-stops
fn-name-delta
force-think
functiongemma-toolcall
generate-assets
generic-thoughts
gguf-read
gguf-read-field
grammar-async
grammar-async3
grammar-copy
grammar-fast
grammar-fast-disable
grammar-fast-linked
grammar-fast-nits
grammar-fast-resampling
grammar-fast-resampling-early
grammar-fast-single
grammar-fast-single2
grammar-from-json-schema
grammar-left-rec
grammar-less-stacks
grammar-rejects
grammar-reps
grammar-reps2
grammar-reps-revert
grammar-resample2
grammar-resampling
grammar-resampling-early
grammar-speedup
grammar-speedup2
grammar-speedup3
grammar-stacks-callbacks
grammar-transitions
grammars-early-exit
grammars-early-exit-resample
grammars-resample
gritlm-url
hip-ccache
install
jf-flag
jinja
jinja-chatml
json_schema
json-additional
json-bounds
json-doc
json-doc3
json-faster-repetitions
json-faster-repetitions2
json-faster-repetitions-bak
json-fixes
json-fixes-cpp
json-fixes-refact
json-integ
json-noadd
json-order
json-order2
json-order3
json-refs
json-refs2
json-schema-file
json-tests
json-type
json-updates
json-ws
kv-tree-cache
lazy-grammar-regex
llama2c-gguf
llama2c-non-shared-weights
llama2c-non-shared-weights-save
llama-lib-rename
lto2
main-json
master
mcp
minja-sync-aug8
minja-sync-minmax
model-args
nit-empty-grammar
ochafik/minja-sync2
offline
opencl-kernels
partial-regex
peg-end-tokens-metadata
peg-migration-complete
peg-migration-complete-history
peg-migration-inline-generic-helper
peg-migration-squashed
peg-migration-squashed-fixes
peg-simplify
quant-lowdisk
quant-lowraw-hack
quant-py
qwen3-chat
r1-toolcall
refector-chat-test
reuse-graphs
reuse-graphs-2
server-cancel
skip-unused
skip-unused-2-save
skip-unused-2
skip-unused-hipblas
stdin-prompt
string_utils
sync-minja-2
sync-minja-5
sync-minja-7
sync-minja-8
sync-minja-reasoning
sync-minja-reasoning-bak
tc-py
test-cli
tmp
tmp-grammar-debug-candidates
tmp-ochafik-masked-training
tmp-ochafik-opencl-clblast
tmp-ochafik-server-py
tmp-opencl-nofp16
token-aware-grammars-impl
tool-bench
tool-bench2
tool-bench-prod
tool-call
tool-call-0
tool-call-1
tool-call-2
tool-call-3
tool-call-bak1
tool-call-caching
tool-call-handler
tool-call-nits
tool-call-simpler
tool-diffs
tool-diffs-bak
tool-diffs-bak2
tool-diffs-bak3
update-functionary-tool-call-doc
url-meta
web-ui-mcp
grammars: refactor to pass grammar around for upcoming changes
Olivier Chafik
committed
1 year ago
225c273b
grammar: prepare headset support for all rule alternatives
Olivier Chafik
committed
1 year ago
313444f1
grammars: prepare llama_grammar_element_head_charset
Olivier Chafik
committed
1 year ago
90ae60bf
grammars: refactor rules to make alternatives easier to poke
Olivier Chafik
committed
1 year ago
1dd90bc5
grammar: reuse decoded tokens and pieces
Olivier Chafik
committed
1 year ago
8ee2a68d
grammars: reuse new_stack vector in llama_grammar_accept
Olivier Chafik
committed
1 year ago
15fe172c
grammars: new_stacks reuse
Olivier Chafik
committed
1 year ago
959d9d34
grammars: reserve rejects & next candidates
Olivier Chafik
committed
1 year ago
a2747858
grammar: cache fully decoded tokens
Olivier Chafik
committed
1 year ago
6c5150a2
grammar: cosmetic reserves
Olivier Chafik
committed
1 year ago
10226922
json: fix server/README (json_schema in /completion vs. result_format in /v1/chat/completions)
Olivier Chafik
committed
1 year ago
9c33ee99
json: fix type error w/ python 3.8
ochafik
committed
1 year ago
67a5184f
nits
ochafik
committed
1 year ago
3c81e944
server+json: update server/README w/ result_format
ochafik
committed
1 year ago
6c885dce
json: support string minLength/maxLength
ochafik
committed
1 year ago
de4e60ea
json: unify all repetition code (w/ or w/o sep)
ochafik
committed
1 year ago
181f984d
json: cap length of numbers to 15 digits before/after decimal point
ochafik
committed
1 year ago
dcf5d328
grammars: add troubleshooting section to readme
ochafik
committed
1 year ago
07163fb6
json: optimize repetitions for minItems/maxItems and regexps: `a{,3}` goes from `"a"? "a"? "a"?` (explosive combos) to `(a (a (a)?)?)?`
ochafik
committed
1 year ago
a59e9431
json: deps management for primitive rules (+ allow null values)
ochafik
committed
1 year ago
159b883b
server: skip null json_schema / grammar fields
ochafik
committed
1 year ago
f771a8f1
json: rename python schema converter to make import easier
ochafik
committed
1 year ago
2148f244
quantize : fix precedence of cli args (#6541)
ggerganov
committed
1 year ago
Verified
b73e564b
llama : support negative ith in llama_get_ API (#6519)
TheFlipbook
committed
1 year ago
Verified
e3c337d8
llama : save and restore kv cache for single seq id (#6341)
kaetemi
committed
1 year ago
Verified
beea6e1b
remove row=1 cond (#6532)
abhilash1910
committed
1 year ago
Verified
87fb5b42
Adding KodiBot to UI list (#6535)
firatkiral
committed
1 year ago
Verified
d752327c
Change Windows AMD example to release build to make inference much faster. (#6525)
thebaron88
committed
1 year ago
Verified
855f5440
flake.lock: Update (#6517)
ggerganov
committed
1 year ago
Verified
b909236c
Add GritLM as supported models. (#6513)
dranger003
committed
1 year ago
Verified
e0717e75
Older