ngxson/llama.cpp

Pull Requests Commits

server: real-time model load progress tracking via /models/sse

ngxson committed 7 hours ago

177707e1

server: refactor child --> router communication (#24821)

ngxson committed 8 hours ago

Verified 2b686a91

server : optimize get_token_probabilities (#24796)

angt committed 10 hours ago

Verified 4b48a53b

mtmd, arg: fix utf8 handling on windows (#24779)

ngxson committed 11 hours ago

Verified e475fa2b

server: remove all internal mentions about "webui" (#24817)

ngxson committed 11 hours ago

Verified 175147e8

arg: Add comment line support to --api-key-file (#23168)

kucharskim committed 15 hours ago

Verified fabde3bf

vendor : update cpp-httplib to 0.48.0 (#24787)

cabelo committed 17 hours ago

Verified 0d2d9ccb

server: add --agent arg, remove redundant webui naming compat (#24801)

ngxson committed 17 hours ago

Verified 8c2d6f64

docker : build the UI (#24794)

aldehir committed 18 hours ago

Verified 38724ab5

mtmd: several bug fixes (#24784)

ngxson committed 21 hours ago

Verified e2e7a9b2

spec: support eagle3 for qwen3.5 & 3.6 (#24593)

ruixiang63 committed 21 hours ago

Verified b14e3fb9

server: fix non-bound n_discard value (ctx shifting) (#24786)

ngxson committed 22 hours ago

Verified 159d093a

ggerganov committed 1 day ago

5fd2dc2c

ggml : bump version to 0.15.2 (ggml/1548)

ggerganov committed 1 day ago

1868af13

pi : remove docs from system prompt (#24791)

ggerganov committed 1 day ago

Verified 5bd21b85

server : consolidate slot selection into get_available_slot (#24755)

ggerganov committed 1 day ago

Verified 80452d65

ggml-cpu: support K tails in power10 Q8/Q4 MMA matmul (#24753)

shalinib-ibm committed 1 day ago

Verified 8141e730

mtmd: add batching support for internvl (#24775)

ngxson committed 1 day ago

Verified db52540f

Ggml/cuda col2im 1d (#24417)

ServeurpersoCom committed 1 day ago

Verified 3a3edc9a

server: add "X-Accel-Buffering": "no" header to streaming endpoints (#24774)

regunakyle committed 1 day ago

Verified 40f3aafc

mtmd: add batching for mtmd-cli, add video tests (#24778)

ngxson committed 1 day ago

Verified a6b3260a

cmake : fix ui build with read-only source (#24752)

o7si committed 1 day ago

Verified 32eddaf2

mtmd: refactor llava-uhd overview image handling (always use ov_img_first) (#24769)

ngxson committed 1 day ago

Verified 060ce1bf

hexagon: support for op-trace (fine-grain tracing of HVX/HMX/DMA events) (#24592)

max-krasnyansky committed 1 day ago

Verified d2c67959

docs: fix export-lora --lora-scaled syntax [no release] (#24703)

kkkzbh committed 1 day ago

Verified 7b6c5a2a

server: (router) fix stopping_thread potentially hang (#24728)

ngxson committed 1 day ago

Verified fe7c8b24

server: add "schema" and validation (#24150)

ngxson committed 1 day ago

Verified e1efd099

server : add last-5-seconds generation speed display (#24291)

akx committed 1 day ago

Verified 08023072

ui: provide touch accessible model selection UI (#24604)

amoshydra committed 1 day ago

Verified 20832179

server : return HTTP 400 on invalid grammar (#24144) (#24154)

Anuj-Attri committed 1 day ago

Verified 10786217

Older