ggerganov/llama.cpp

Pull Requests Commits

poc: threadpool sampling

ngxson committed 8 hours ago

447b0c36

debug: force llama_synchronize for accurate timings

ngxson committed 10 hours ago

a527509d

(debug) add timings

ngxson committed 10 hours ago

7486a397

ngxson committed 10 hours ago

ea65a4b1

Merge branch 'master' into xsn/server_refactor_batch

ngxson committed 10 hours ago

b28e3682

ngxson committed 10 hours ago

53763db7

arg: try fixing test-args-parser randomly fails (#24826)

ngxson committed 10 hours ago

Verified 75f460ac

ngxson committed 11 hours ago

bf36838e

handle batch full more carefully

ngxson committed 11 hours ago

64ec03d1

add abort_all_slots

ngxson committed 11 hours ago

d704c792

ngxson committed 11 hours ago

af583e3e

ngxson committed 11 hours ago

b786bb2e

ngxson committed 11 hours ago

2b2eed8f

release: add missing link for win opencl adreno arm64 (#24809)

muhammad-salem committed 13 hours ago

Verified 84528246

ngxson committed 13 hours ago

6c5c5a29

server: refactor batch construction

ngxson committed 13 hours ago

d5037c50

server: avoid forwarding auth headers in CORS proxy (#24373)

ItsMatti4 committed 15 hours ago

Verified e27f3085

docker : prebuild web UI for s390x build [no release] (#24829)

aldehir committed 17 hours ago

Verified 67e9fd3b

model : glm-dsa load DSA indexer tensors as optional (#24770)

davidrhodus committed 17 hours ago

Verified 796f41be

ggml : optimize AMX (#24806)

angt committed 17 hours ago

Verified 37a77fb0

convert : more consistent handling of rope_parameters (#24833)

CISC committed 17 hours ago

Verified f4043fec

ggml-webgpu: add adapter toggles for F16 on Vulkan + NVIDIA

yomaytk committed 1 day ago

Verified f449e055

server: refactor child --> router communication (#24821)

ngxson committed 1 day ago

Verified 2b686a91

server : optimize get_token_probabilities (#24796)

angt committed 1 day ago

Verified 4b48a53b

mtmd, arg: fix utf8 handling on windows (#24779)

ngxson committed 1 day ago

Verified e475fa2b

server: remove all internal mentions about "webui" (#24817)

ngxson committed 1 day ago

Verified 175147e8

arg: Add comment line support to --api-key-file (#23168)

kucharskim committed 1 day ago

Verified fabde3bf

vendor : update cpp-httplib to 0.48.0 (#24787)

cabelo committed 1 day ago

Verified 0d2d9ccb

server: add --agent arg, remove redundant webui naming compat (#24801)

ngxson committed 1 day ago

Verified 8c2d6f64

docker : build the UI (#24794)

aldehir committed 1 day ago

Verified 38724ab5

Older