ggml-org/llama.cpp

Pull Requests Commits

disable DEBUG_TIMINGS

ngxson committed 46 days ago

7ac864bf

address comments

ngxson committed 46 days ago

d3741451

debug: force llama_synchronize for accurate timings

ngxson committed 47 days ago

a527509d

(debug) add timings

ngxson committed 47 days ago

7486a397

ngxson committed 47 days ago

ea65a4b1

Merge branch 'master' into xsn/server_refactor_batch

ngxson committed 47 days ago

b28e3682

ngxson committed 47 days ago

53763db7

arg: try fixing test-args-parser randomly fails (#24826)

ngxson committed 47 days ago

Verified 75f460ac

ngxson committed 47 days ago

bf36838e

handle batch full more carefully

ngxson committed 47 days ago

64ec03d1

add abort_all_slots

ngxson committed 47 days ago

d704c792

ngxson committed 47 days ago

af583e3e

ngxson committed 47 days ago

b786bb2e

ngxson committed 47 days ago

2b2eed8f

release: add missing link for win opencl adreno arm64 (#24809)

muhammad-salem committed 47 days ago

Verified 84528246

ngxson committed 47 days ago

6c5c5a29

server: refactor batch construction

ngxson committed 47 days ago

d5037c50

server: avoid forwarding auth headers in CORS proxy (#24373)

ItsMatti4 committed 47 days ago

Verified e27f3085

docker : prebuild web UI for s390x build [no release] (#24829)

aldehir committed 47 days ago

Verified 67e9fd3b

model : glm-dsa load DSA indexer tensors as optional (#24770)

davidrhodus committed 47 days ago

Verified 796f41be

ggml : optimize AMX (#24806)

angt committed 47 days ago

Verified 37a77fb0

convert : more consistent handling of rope_parameters (#24833)

CISC committed 47 days ago

Verified f4043fec

ggml-webgpu: add adapter toggles for F16 on Vulkan + NVIDIA

yomaytk committed 47 days ago

Verified f449e055

server: refactor child --> router communication (#24821)

ngxson committed 47 days ago

Verified 2b686a91

server : optimize get_token_probabilities (#24796)

angt committed 47 days ago

Verified 4b48a53b

mtmd, arg: fix utf8 handling on windows (#24779)

ngxson committed 47 days ago

Verified e475fa2b

server: remove all internal mentions about "webui" (#24817)

ngxson committed 47 days ago

Verified 175147e8

arg: Add comment line support to --api-key-file (#23168)

kucharskim committed 48 days ago

Verified fabde3bf

vendor : update cpp-httplib to 0.48.0 (#24787)

cabelo committed 48 days ago

Verified 0d2d9ccb

server: add --agent arg, remove redundant webui naming compat (#24801)

ngxson committed 48 days ago

Verified 8c2d6f64

Older