ggerganov/llama.cpp

Pull Requests Commits
ggml : optimize AMX (#24806)
angt committed 12 days ago
Verified 37a77fb0
convert : more consistent handling of rope_parameters (#24833)
CISC committed 12 days ago
Verified f4043fec
ggml-webgpu: add adapter toggles for F16 on Vulkan + NVIDIA
yomaytk committed 12 days ago
Verified f449e055
server: refactor child --> router communication (#24821)
ngxson committed 12 days ago
Verified 2b686a91
server : optimize get_token_probabilities (#24796)
angt committed 12 days ago
Verified 4b48a53b
mtmd, arg: fix utf8 handling on windows (#24779)
ngxson committed 12 days ago
Verified e475fa2b
server: remove all internal mentions about "webui" (#24817)
ngxson committed 12 days ago
Verified 175147e8
arg: Add comment line support to --api-key-file (#23168)
kucharskim committed 12 days ago
Verified fabde3bf
vendor : update cpp-httplib to 0.48.0 (#24787)
cabelo committed 13 days ago
Verified 0d2d9ccb
server: add --agent arg, remove redundant webui naming compat (#24801)
ngxson committed 13 days ago
Verified 8c2d6f64
docker : build the UI (#24794)
aldehir committed 13 days ago
Verified 38724ab5
mtmd: several bug fixes (#24784)
ngxson committed 13 days ago
Verified e2e7a9b2
spec: support eagle3 for qwen3.5 & 3.6 (#24593)
ruixiang63 committed 13 days ago
Verified b14e3fb9
server: fix non-bound n_discard value (ctx shifting) (#24786)
ngxson committed 13 days ago
Verified 159d093a
sync : ggml
ggerganov committed 13 days ago
5fd2dc2c
ggml : bump version to 0.15.2 (ggml/1548)
ggerganov committed 13 days ago
1868af13
pi : remove docs from system prompt (#24791)
ggerganov committed 13 days ago
Verified 5bd21b85
server : consolidate slot selection into get_available_slot (#24755)
ggerganov committed 13 days ago
Verified 80452d65
ggml-cpu: support K tails in power10 Q8/Q4 MMA matmul (#24753)
shalinib-ibm committed 13 days ago
Verified 8141e730
mtmd: add batching support for internvl (#24775)
ngxson committed 13 days ago
Verified db52540f
Ggml/cuda col2im 1d (#24417)
ServeurpersoCom committed 13 days ago
Verified 3a3edc9a
server: add "X-Accel-Buffering": "no" header to streaming endpoints (#24774)
regunakyle committed 13 days ago
Verified 40f3aafc
mtmd: add batching for mtmd-cli, add video tests (#24778)
ngxson committed 13 days ago
Verified a6b3260a
cmake : fix ui build with read-only source (#24752)
o7si committed 13 days ago
Verified 32eddaf2
mtmd: refactor llava-uhd overview image handling (always use ov_img_first) (#24769)
ngxson committed 13 days ago
Verified 060ce1bf
hexagon: support for op-trace (fine-grain tracing of HVX/HMX/DMA events) (#24592)
max-krasnyansky committed 13 days ago
Verified d2c67959
docs: fix export-lora --lora-scaled syntax [no release] (#24703)
kkkzbh committed 14 days ago
Verified 7b6c5a2a
server: (router) fix stopping_thread potentially hang (#24728)
ngxson committed 14 days ago
Verified fe7c8b24
server: add "schema" and validation (#24150)
ngxson committed 14 days ago
Verified e1efd099
server : add last-5-seconds generation speed display (#24291)
akx committed 14 days ago
Verified 08023072
Terms Of Use Privacy Policy Refund Policy Impressum