ggerganov/llama.cpp

Pull Requests Commits

server: add dedup-cache-models preset option

ngxson committed 27 days ago

5fd3e06e

opencl: fix WAR race in the generic FA tile kernels when the WG spans subgroups (#26434)

wanghqc committed 27 days ago

Verified 60addddf

mtmd: deepseek-ocr SAM ggml_conv_2d with the im2col kept in F32 (#26727)

sfallah committed 28 days ago

Verified 9731ad3f

RPC: populate use_count to enable fusion inside backends (#27142)

am17an committed 28 days ago

Verified af517262

ui: Services consolidation refactor (#27239)

allozaur committed 28 days ago

Verified 3dc7285b

ui: Stores consolidation refactor (#27238)

allozaur committed 28 days ago

Verified fdf4c646

common: share thread pools when `n_threads` differ (#27138)

nikwen committed 28 days ago

Verified 04b56914

quant : Optimise memory usage by evicting weights after processing each layer (#22877)

EAddario committed 28 days ago

Verified 05967042

sycl: honor GGML_HINT_SRC0_IS_HADAMARD (#27298)

Titaniumtown committed 28 days ago

Verified 0882c7bc

unicode : include '~' in collapsed symbol class (#26972)

tarruda committed 28 days ago

Verified afd439df

readme : update status badges + regen AUTHORS (#27317)

ggerganov committed 28 days ago

Verified 169e4a7f

ci : Update OpenVINO to 2026.3, skip nemotron-h rollback test (#27292)

wine99 committed 28 days ago

Verified 9d77fa17

ci: add Windows ARM64 CUDA support to the manual workflow (#27300)

shivamkumard-ctrl committed 28 days ago

Verified c0296022

mtmd: fix LFM2 image tiling threshold (#27057)

BlackFoil committed 28 days ago

Verified 7acdbb1f

ggerganov committed 28 days ago

1511ce3b

ggml : bump version to 0.20.2 (ggml/1589)

ggerganov committed 28 days ago

da786dc2

build : fix xcframework + cmake clean-up (#27304)

ggerganov committed 28 days ago

Verified 27e345b5

ci : create pre-release with change log and nightly link in make-release (#27302)

ggerganov committed 28 days ago

Verified 8b864009

CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark (#26843)

ynankani committed 28 days ago

Verified 25ae3a9b

ui: enforce alphabetical enum member ordering (#27272)

ngxson committed 28 days ago

Verified 01818e49

ui: Refactor Built-In Tools naming (Server/Browser) (#27271)

allozaur committed 28 days ago

Verified 0021a77d

ci: more optimizations (#26983)

netrunnereve committed 28 days ago

Verified 058df671

doc: document MCP stdio servers and CORS defaults in the server README [no release] [no ci] (#26847)

ServeurpersoCom committed 28 days ago

Verified 087f94d8

server: save processed mtmd chunks as placeholder (#27278)

ngxson committed 29 days ago

Verified 533b1825

mtmd: use sha256 for input hashing (#27274)

ngxson committed 29 days ago

Verified ed1c3a20

vocab : support integer tokenizer scores (#27260)

CISC committed 29 days ago

Verified d8df12eb

mtmd : skip thumbnail for non-tiled LFM2 images (#27246)

tdakhran committed 29 days ago

Verified b75ecd19

cuda : skip UMA override for HIP builds (#27083)

superm1 committed 29 days ago

Verified 60eeeb60

vendor: move hash to vendor (#27262)

ngxson committed 29 days ago

Verified 39be55c9

ci : push release tag explicitly in release.yml (#27261)

ggerganov committed 29 days ago

Verified 34af94cd

Older