ggml-org/llama.cpp

Pull Requests Commits

should_reset_buckets

ngxson committed 49 days ago

0baf73ad

split metrics and slots tasks / results

ngxson committed 49 days ago

c1fc93f2

fix a race condition

ngxson committed 50 days ago

0591080c

ngxson committed 50 days ago

8ca19551

fix get_res_model_info

ngxson committed 50 days ago

dd7803d3

ngxson committed 50 days ago

7fa2fdbb

ngxson committed 50 days ago

2ccdc2f7

metrics task should not reset timer

ngxson committed 50 days ago

f5aef6ab

allow accessing metrics during sleep

ngxson committed 50 days ago

abdb18dd

refactor on_sleeping_state

ngxson committed 50 days ago

5b776fdf

add cached responses

ngxson committed 50 days ago

9f710a6e

server: add dedup-cache-models preset option (#27346)

ngxson committed 50 days ago

Verified ee4c505a

vulkan: tiled transpose for 0<->2 permuted CONT (#26585)

kh0pper committed 50 days ago

Verified 98d1e92c

ggml-webgpu: add mulmat with overlapping src0/src1 (e.g., for minimax-01) (#27321)

yomaytk committed 50 days ago

Verified 5112b973

ci : add attestation for signed release artifacts (#25933)

quartzjer committed 50 days ago

Verified 0adcc3bb

tests: skip test-unicode build on win32/BUILD_SHARED_LIBS (#27336)

jeffbolznv committed 50 days ago

Verified 79fe7991

gguf-py : add size guards to GGUFReader (#27188)

oakkaya committed 50 days ago

Verified 0329fcda

server: (cosmetic) do not print cmd_child_to_router messages [no release] (#27347)

ngxson committed 50 days ago

Verified 6d054983

opencl: fix WAR race in the generic FA tile kernels when the WG spans subgroups (#26434)

wanghqc committed 50 days ago

Verified 60addddf

mtmd: deepseek-ocr SAM ggml_conv_2d with the im2col kept in F32 (#26727)

sfallah committed 50 days ago

Verified 9731ad3f

RPC: populate use_count to enable fusion inside backends (#27142)

am17an committed 50 days ago

Verified af517262

ui: Services consolidation refactor (#27239)

allozaur committed 50 days ago

Verified 3dc7285b

ui: Stores consolidation refactor (#27238)

allozaur committed 50 days ago

Verified fdf4c646

common: share thread pools when `n_threads` differ (#27138)

nikwen committed 50 days ago

Verified 04b56914

quant : Optimise memory usage by evicting weights after processing each layer (#22877)

EAddario committed 50 days ago

Verified 05967042

sycl: honor GGML_HINT_SRC0_IS_HADAMARD (#27298)

Titaniumtown committed 50 days ago

Verified 0882c7bc

unicode : include '~' in collapsed symbol class (#26972)

tarruda committed 50 days ago

Verified afd439df

readme : update status badges + regen AUTHORS (#27317)

ggerganov committed 51 days ago

Verified 169e4a7f

ci : Update OpenVINO to 2026.3, skip nemotron-h rollback test (#27292)

wine99 committed 51 days ago

Verified 9d77fa17

ci: add Windows ARM64 CUDA support to the manual workflow (#27300)

shivamkumard-ctrl committed 51 days ago

Verified c0296022

Older