ggerganov/llama.cpp

Pull Requests Commits

vulkan: check coopmat2 features before reporting support

0cc4m committed 7 hours ago

ca8b62bd

docs: Update quantization readme (#24133)

pcuenca committed 11 hours ago

Verified ad1b88ca

minor : fix lint issues (#24165)

ggerganov committed 13 hours ago

Verified 59917d39

hparams : refactor `hparams.n_layer` (#24060)

ggerganov committed 13 hours ago

Verified 7acb4e8c

kleidiai : dynamic chunck-based scheduling for hybrid execution (#23819)

chaxu01 committed 14 hours ago

Verified 3ecfb150

CUDA: enroll mul_mat_vec_q_moe into pdl (#24087)

ORippler committed 14 hours ago

Verified 2154a0fd

ci : build-msys job slimming [no ci] (#24157)

danbev committed 15 hours ago

Verified 46fa662b

sycl : port multi-column MMVQ from CUDA backend (#21845)

masonmilby committed 16 hours ago

Verified 7fe2ae45

server : disable on-device spec checkpoints (#24108)

ggerganov committed 1 day ago

Verified 7c158fbb

arg: fix double mtp downloads (#24128)

ngxson committed 1 day ago

Verified 260862b8

webui: [a11y] fix keyboard navigation issues in chat interface and sidebar (#23132)

vignesh191 committed 1 day ago

Verified 42b2d60e

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

bartowski1182 committed 1 day ago

Verified e7bcf1c3

ui: Fixed packages (#24119)

allozaur committed 1 day ago

Verified 21444c82

ui: added single line reasoning preview (#23601)

gugugiyu committed 1 day ago

Verified 52697706

return filter to save memory (#24125)

forforever73 committed 1 day ago

Verified 0dbfa66a

convert: Fix Gemma 4 Unified conversion (#24118)

pcuenca committed 1 day ago

Verified e8023568

ggml: vectorize ggml_vec_dot_q4_1_q8_1 with WASM SIMD128 (#22209)

sirohikartik committed 1 day ago

Verified 4c513096

server: avoid unnecessary checkpoint restore when new tokens are present (#24110)

Abioy committed 1 day ago

Verified 6f3a9f3d

agents: refactor, include more guidelines (#24111)

ngxson committed 1 day ago

Verified a121232f

webui: fix tool selector toggle/counter, key tools by stable identity (#24065)

ServeurpersoCom committed 1 day ago

Verified 45864798

build : use umbrella Headers directory for XCFramework module map (#23974)

gmarzjr committed 1 day ago

Verified 4d742877

server : add header to tools/server/server-http.h (#24089)

abawany committed 1 day ago

Verified 00664040

cmake: skip cvector-generator and export-lora when CPU backend is disabled (#24053)

arichiardi committed 1 day ago

Verified 7ac5a422

fix(mtmd): handle Gemma 4 audio projector embedding size (#24091)

abetlen committed 1 day ago

Verified e3ba22d6

readme : add status badges (#24104)

ggerganov committed 1 day ago

Verified 6ddc9430

tests : refactor test-save-load-state to accept token input (#24073)

ggerganov committed 1 day ago

Verified 65ef50a0

metal : reduce rset heartbeat from 500ms -> 5ms (#24074)

ggerganov committed 1 day ago

Verified 3d199863

ggml-webgpu: FlashAttention refactor + standardize quantization support (#23834)

reeselevine committed 1 day ago

Verified e8c54893

ggml-cpu: extend RVV quantization vec dot to higher VLENs (#22754)

rehan-10xengineer committed 1 day ago

Verified 3c7450ce

sycl : Improve SYCL doc (#23025)

malsbat committed 1 day ago

Verified f478f1b6

Older