ggml-org/llama.cpp

Pull Requests Commits

(debug) add timings

ngxson committed 4 minutes ago

7486a397

ngxson committed 22 minutes ago

ea65a4b1

Merge branch 'master' into xsn/server_refactor_batch

ngxson committed 28 minutes ago

b28e3682

ngxson committed 28 minutes ago

53763db7

arg: try fixing test-args-parser randomly fails (#24826)

ngxson committed 31 minutes ago

Verified 75f460ac

ngxson committed 44 minutes ago

bf36838e

handle batch full more carefully

ngxson committed 45 minutes ago

64ec03d1

add abort_all_slots

ngxson committed 56 minutes ago

d704c792

ngxson committed 58 minutes ago

af583e3e

ngxson committed 1 hour ago

b786bb2e

ngxson committed 1 hour ago

2b2eed8f

release: add missing link for win opencl adreno arm64 (#24809)

muhammad-salem committed 3 hours ago

Verified 84528246

ngxson committed 3 hours ago

6c5c5a29

server: refactor batch construction

ngxson committed 3 hours ago

d5037c50

server: avoid forwarding auth headers in CORS proxy (#24373)

ItsMatti4 committed 4 hours ago

Verified e27f3085

docker : prebuild web UI for s390x build [no release] (#24829)

aldehir committed 7 hours ago

Verified 67e9fd3b

model : glm-dsa load DSA indexer tensors as optional (#24770)

davidrhodus committed 7 hours ago

Verified 796f41be

ggml : optimize AMX (#24806)

angt committed 7 hours ago

Verified 37a77fb0

convert : more consistent handling of rope_parameters (#24833)

CISC committed 7 hours ago

Verified f4043fec

ggml-webgpu: add adapter toggles for F16 on Vulkan + NVIDIA

yomaytk committed 19 hours ago

Verified f449e055

server: refactor child --> router communication (#24821)

ngxson committed 19 hours ago

Verified 2b686a91

server : optimize get_token_probabilities (#24796)

angt committed 20 hours ago

Verified 4b48a53b

mtmd, arg: fix utf8 handling on windows (#24779)

ngxson committed 21 hours ago

Verified e475fa2b

server: remove all internal mentions about "webui" (#24817)

ngxson committed 22 hours ago

Verified 175147e8

arg: Add comment line support to --api-key-file (#23168)

kucharskim committed 1 day ago

Verified fabde3bf

vendor : update cpp-httplib to 0.48.0 (#24787)

cabelo committed 1 day ago

Verified 0d2d9ccb

server: add --agent arg, remove redundant webui naming compat (#24801)

ngxson committed 1 day ago

Verified 8c2d6f64

docker : build the UI (#24794)

aldehir committed 1 day ago

Verified 38724ab5

mtmd: several bug fixes (#24784)

ngxson committed 1 day ago

Verified e2e7a9b2

spec: support eagle3 for qwen3.5 & 3.6 (#24593)

ruixiang63 committed 1 day ago

Verified b14e3fb9

Older