ngxson/llama.cpp

Pull Requests Commits

kleidiai : dynamic chunck-based scheduling for hybrid execution (#23819)

chaxu01 committed 5 days ago

Verified 3ecfb150

CUDA: enroll mul_mat_vec_q_moe into pdl (#24087)

ORippler committed 5 days ago

Verified 2154a0fd

ci : build-msys job slimming [no ci] (#24157)

danbev committed 5 days ago

Verified 46fa662b

sycl : port multi-column MMVQ from CUDA backend (#21845)

masonmilby committed 5 days ago

Verified 7fe2ae45

server : disable on-device spec checkpoints (#24108)

ggerganov committed 6 days ago

Verified 7c158fbb

arg: fix double mtp downloads (#24128)

ngxson committed 6 days ago

Verified 260862b8

webui: [a11y] fix keyboard navigation issues in chat interface and sidebar (#23132)

vignesh191 committed 6 days ago

Verified 42b2d60e

Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)

bartowski1182 committed 6 days ago

Verified e7bcf1c3

ui: Fixed packages (#24119)

allozaur committed 6 days ago

Verified 21444c82

ui: added single line reasoning preview (#23601)

gugugiyu committed 6 days ago

Verified 52697706

return filter to save memory (#24125)

forforever73 committed 6 days ago

Verified 0dbfa66a

convert: Fix Gemma 4 Unified conversion (#24118)

pcuenca committed 6 days ago

Verified e8023568

ggml: vectorize ggml_vec_dot_q4_1_q8_1 with WASM SIMD128 (#22209)

sirohikartik committed 6 days ago

Verified 4c513096

server: avoid unnecessary checkpoint restore when new tokens are present (#24110)

Abioy committed 6 days ago

Verified 6f3a9f3d

agents: refactor, include more guidelines (#24111)

ngxson committed 6 days ago

Verified a121232f

webui: fix tool selector toggle/counter, key tools by stable identity (#24065)

ServeurpersoCom committed 6 days ago

Verified 45864798

build : use umbrella Headers directory for XCFramework module map (#23974)

gmarzjr committed 6 days ago

Verified 4d742877

server : add header to tools/server/server-http.h (#24089)

abawany committed 6 days ago

Verified 00664040

cmake: skip cvector-generator and export-lora when CPU backend is disabled (#24053)

arichiardi committed 6 days ago

Verified 7ac5a422

fix(mtmd): handle Gemma 4 audio projector embedding size (#24091)

abetlen committed 6 days ago

Verified e3ba22d6

readme : add status badges (#24104)

ggerganov committed 6 days ago

Verified 6ddc9430

tests : refactor test-save-load-state to accept token input (#24073)

ggerganov committed 6 days ago

Verified 65ef50a0

metal : reduce rset heartbeat from 500ms -> 5ms (#24074)

ggerganov committed 6 days ago

Verified 3d199863

ggml-webgpu: FlashAttention refactor + standardize quantization support (#23834)

reeselevine committed 6 days ago

Verified e8c54893

ggml-cpu: extend RVV quantization vec dot to higher VLENs (#22754)

rehan-10xengineer committed 6 days ago

Verified 3c7450ce

sycl : Improve SYCL doc (#23025)

malsbat committed 6 days ago

Verified f478f1b6

mtmd: fix Gemma 4 unified FPE (#24088)

abetlen committed 7 days ago

Verified 94a220cd

qwen35: use post-norm hidden state for MTP (#24025)

am17an committed 7 days ago

Verified 166fe294

mtmd: enable non-causal vision for gemma 4 unified (#24082)

ngxson committed 7 days ago

Verified c8d6a006

mtmd, model: allow skip build_vit() (#24077)

ngxson committed 7 days ago

Verified a731805c

Newer Older