ggml-org/llama.cpp

Pull Requests Commits

metal : fix im2col 1D case (audio models)

ngxson committed 2 hours ago

46b51bcf

opencl: improve get_rows, cpy, concat and q6_k flat gemv (#24160)

lhez committed 5 hours ago

Verified 308f61c3

common/chat : unify and fix LFM2/LFM2.5 tool parser (#24178)

tdakhran committed 6 hours ago

Verified da87e9b6

vulkan: add fwht support for Intel with shmem reduction (#23964)

0cc4m committed 8 hours ago

Verified e82beaa6

model: fix build failed (#24193)

ngxson committed 10 hours ago

Verified c4a278d6

model, mtmd: Granite4 Vision (#23545)

gabe-l-hart committed 10 hours ago

Verified 64086f2b

TP: round up granularity to 128 (#24180)

JohannesGaessler committed 10 hours ago

Verified 6effcecd

cli: fix model params not propagated (#23893)

therealkenc committed 10 hours ago

Verified 86591c75

model : fix llama_model::n_gpu_layers() (#24188)

ggerganov committed 12 hours ago

Verified 96fbe003

ui: run npm install when package-lock.json is newer than node_modules (#24171)

ServeurpersoCom committed 13 hours ago

Verified 2016bf2b

Fix link to available UI settings (#24169)

wariuccio committed 13 hours ago

Verified 9c955c48

ui: add ignore-scripts=true to npmrc (#24149)

ngxson committed 13 hours ago

Verified cc7bef34

docs: Update quantization readme (#24133)

pcuenca committed 15 hours ago

Verified ad1b88ca

minor : fix lint issues (#24165)

ggerganov committed 18 hours ago

Verified 59917d39

hparams : refactor `hparams.n_layer` (#24060)

ggerganov committed 18 hours ago

Verified 7acb4e8c

kleidiai : dynamic chunck-based scheduling for hybrid execution (#23819)

chaxu01 committed 19 hours ago

Verified 3ecfb150

CUDA: enroll mul_mat_vec_q_moe into pdl (#24087)

ORippler committed 19 hours ago

Verified 2154a0fd

ci : build-msys job slimming [no ci] (#24157)

danbev committed 20 hours ago

Verified 46fa662b

sycl : port multi-column MMVQ from CUDA backend (#21845)

masonmilby committed 21 hours ago

Verified 7fe2ae45

server : disable on-device spec checkpoints (#24108)

ggerganov committed 1 day ago

Verified 7c158fbb

arg: fix double mtp downloads (#24128)

ngxson committed 1 day ago

Verified 260862b8

webui: [a11y] fix keyboard navigation issues in chat interface and sidebar (#23132)

vignesh191 committed 1 day ago

Verified 42b2d60e

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

bartowski1182 committed 1 day ago

Verified e7bcf1c3

ui: Fixed packages (#24119)

allozaur committed 1 day ago

Verified 21444c82

ui: added single line reasoning preview (#23601)

gugugiyu committed 1 day ago

Verified 52697706

return filter to save memory (#24125)

forforever73 committed 1 day ago

Verified 0dbfa66a

convert: Fix Gemma 4 Unified conversion (#24118)

pcuenca committed 1 day ago

Verified e8023568

ggml: vectorize ggml_vec_dot_q4_1_q8_1 with WASM SIMD128 (#22209)

sirohikartik committed 1 day ago

Verified 4c513096

server: avoid unnecessary checkpoint restore when new tokens are present (#24110)

Abioy committed 1 day ago

Verified 6f3a9f3d

agents: refactor, include more guidelines (#24111)

ngxson committed 1 day ago

Verified a121232f

Older