ggml-org/llama.cpp

Pull Requests Commits

fix Gemma4 with no audio encoder

CISC committed 1 hour ago

Verified 2293cc37

mtmd: support "frame merge" for qwen-vl-based models (#21858)

ngxson committed 1 hour ago

Verified 31e82494

completion : remove useless statics (#24226)

angt committed 10 hours ago

Verified 6b80c74f

completion : fix format specifier in LOG_INF (#24213)

angt committed 11 hours ago

Verified 588f0dc2

mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

ngxson committed 12 hours ago

Verified f5c6ae18

vulkan: check coopmat2 features before reporting support (#24186)

0cc4m committed 13 hours ago

Verified 5a69c974

model : rename local n_layer_all variable (#24209)

CISC committed 16 hours ago

Verified 5343f450

context : fix off-by-one comparisons to n_gpu_layers (#24208)

CISC committed 17 hours ago

Verified 603300b0

opencl: improve get_rows, cpy, concat and q6_k flat gemv (#24160)

lhez committed 1 day ago

Verified 308f61c3

common/chat : unify and fix LFM2/LFM2.5 tool parser (#24178)

tdakhran committed 1 day ago

Verified da87e9b6

vulkan: add fwht support for Intel with shmem reduction (#23964)

0cc4m committed 1 day ago

Verified e82beaa6

model: fix build failed (#24193)

ngxson committed 1 day ago

Verified c4a278d6

model, mtmd: Granite4 Vision (#23545)

gabe-l-hart committed 1 day ago

Verified 64086f2b

TP: round up granularity to 128 (#24180)

JohannesGaessler committed 1 day ago

Verified 6effcecd

cli: fix model params not propagated (#23893)

therealkenc committed 1 day ago

Verified 86591c75

model : fix llama_model::n_gpu_layers() (#24188)

ggerganov committed 1 day ago

Verified 96fbe003

ui: run npm install when package-lock.json is newer than node_modules (#24171)

ServeurpersoCom committed 1 day ago

Verified 2016bf2b

Fix link to available UI settings (#24169)

wariuccio committed 1 day ago

Verified 9c955c48

ui: add ignore-scripts=true to npmrc (#24149)

ngxson committed 1 day ago

Verified cc7bef34

docs: Update quantization readme (#24133)

pcuenca committed 1 day ago

Verified ad1b88ca

minor : fix lint issues (#24165)

ggerganov committed 1 day ago

Verified 59917d39

hparams : refactor `hparams.n_layer` (#24060)

ggerganov committed 1 day ago

Verified 7acb4e8c

kleidiai : dynamic chunck-based scheduling for hybrid execution (#23819)

chaxu01 committed 1 day ago

Verified 3ecfb150

CUDA: enroll mul_mat_vec_q_moe into pdl (#24087)

ORippler committed 1 day ago

Verified 2154a0fd

ci : build-msys job slimming [no ci] (#24157)

danbev committed 1 day ago

Verified 46fa662b

sycl : port multi-column MMVQ from CUDA backend (#21845)

masonmilby committed 1 day ago

Verified 7fe2ae45

server : disable on-device spec checkpoints (#24108)

ggerganov committed 2 days ago

Verified 7c158fbb

arg: fix double mtp downloads (#24128)

ngxson committed 2 days ago

Verified 260862b8

webui: [a11y] fix keyboard navigation issues in chat interface and sidebar (#23132)

vignesh191 committed 2 days ago

Verified 42b2d60e

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

bartowski1182 committed 2 days ago

Verified e7bcf1c3

Older