ngxson/llama.cpp

Pull Requests Commits

set LLAMA_ARG_TERMINATE_MODE on router

ngxson committed 2 days ago

9ed7a1a3

add --terminate-mode

ngxson committed 2 days ago

2a328226

use meta timeout

ngxson committed 2 days ago

4e4a609c

ngxson committed 2 days ago

9181c677

server: (router) wait on-going request before LRU evict

ngxson committed 2 days ago

50035fc8

server: refactor batch construction (#24843)

ngxson committed 3 days ago

Verified bddfd2b1

mtmd: fix mtmd_get_memory_usage (#24867)

ngxson committed 3 days ago

Verified 0d135df4

jinja : implement call statement (#24847)

CISC committed 3 days ago

Verified bf533823

mtmd: add load progress callback (#24865)

ngxson committed 3 days ago

Verified 2f89acc2

server: add "verbose" field to schema (#24864)

ngxson committed 3 days ago

Verified bfa32191

server: real-time model load progress tracking via /models/sse (#24828)

ngxson committed 3 days ago

Verified d6d89958

minor : clean-up whitespaces (#24862)

ggerganov committed 3 days ago

Verified 8a118ee8

spec : Support Step3.5/3.7 flash mtp3 (#24340)

forforever73 committed 3 days ago

Verified d7895274

common/peg : refactor until gbnf grammar generation (#24839)

aldehir committed 3 days ago

Verified 063d9c15

common/json-schema-to-grammar : align spacing rules with parsers (#24835)

aldehir committed 3 days ago

Verified c5760701

fix(hexagon): use padded stride for ssm-conv weights (#24470)

BiReRa committed 3 days ago

Verified 4a809431

llama : use LLM_KV for quantization_version & file_type (#24802)

angt committed 3 days ago

Verified 84de01a1

arg: try fixing test-args-parser randomly fails (#24826)

ngxson committed 3 days ago

Verified 75f460ac

release: add missing link for win opencl adreno arm64 (#24809)

muhammad-salem committed 3 days ago

Verified 84528246

server: avoid forwarding auth headers in CORS proxy (#24373)

ItsMatti4 committed 4 days ago

Verified e27f3085

docker : prebuild web UI for s390x build [no release] (#24829)

aldehir committed 4 days ago

Verified 67e9fd3b

model : glm-dsa load DSA indexer tensors as optional (#24770)

davidrhodus committed 4 days ago

Verified 796f41be

ggml : optimize AMX (#24806)

angt committed 4 days ago

Verified 37a77fb0

convert : more consistent handling of rope_parameters (#24833)

CISC committed 4 days ago

Verified f4043fec

ggml-webgpu: add adapter toggles for F16 on Vulkan + NVIDIA

yomaytk committed 4 days ago

Verified f449e055

server: refactor child --> router communication (#24821)

ngxson committed 4 days ago

Verified 2b686a91

server : optimize get_token_probabilities (#24796)

angt committed 4 days ago

Verified 4b48a53b

mtmd, arg: fix utf8 handling on windows (#24779)

ngxson committed 4 days ago

Verified e475fa2b

server: remove all internal mentions about "webui" (#24817)

ngxson committed 4 days ago

Verified 175147e8

arg: Add comment line support to --api-key-file (#23168)

kucharskim committed 4 days ago

Verified fabde3bf

Older