ggml-org/llama.cpp

Pull Requests Commits

ngxson committed 3 days ago

cc25b262

chat : pass reasoning_effort to template

sobakasu committed 4 days ago

Verified 7e4c0a96

ggerganov committed 4 days ago

9b05354e

ggml : bump version to 0.20.0 (ggml/1584)

ggerganov committed 4 days ago

06ae2326

ggml : recurrent state rollback for ggml_ssm_scan (#26623)

lnigam committed 4 days ago

Verified 1692f9e5

llama : allow virtual igpu devices (#26953)

ggerganov committed 4 days ago

Verified 4c1a0af4

server: allow accessing /metrics and /slots during llama_decode() (#27041)

ngxson committed 4 days ago

Verified 77918caf

tests : replace personal home directory paths with generic placeholders (#27043)

jimw567 committed 4 days ago

Verified 885c5bbe

sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (#26779)

Titaniumtown committed 4 days ago

Verified 65091386

ggml: force single thread on wasi (#25686)

MendyBerger committed 4 days ago

Verified c6f6a92c

sycl: fuse the gated-delta-net state writeback cpy (#26643)

Titaniumtown committed 4 days ago

Verified 3d938853

dflash : clarify output logging of target_layer_ids (#27013)

danbev committed 4 days ago

Verified 2bacf9ea

common: apply CPU parameters across tools (#27026)

nikwen committed 5 days ago

Verified a94d563e

ui: Refactor data-attrs constants, enum for bool strings (#27002)

ServeurpersoCom committed 5 days ago

Verified bdffafa5

refactor: Naming (#27001)

allozaur committed 5 days ago

Verified fa4ec459

ui: fix VITE_PUBLIC_SERVER variable reading (#24845)

brainrom committed 5 days ago

Verified 9c5531e2

OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (#26952)

wine99 committed 5 days ago

Verified aee56b3a

[SYCL] Support host pinned mem to improve SYCL Host-to-Device Memory Access (#26789)

arthw committed 5 days ago

Verified a97123e4

chat : fix LFM2 tool call arg name prefix ambiguity (#26960)

aldehir committed 5 days ago

Verified 2606220d

server : serve index.html with no-cache (#27006)

erusev committed 5 days ago

Verified 981184e4

spec : auto-detect mtp draft model type (#27005)

CISC committed 5 days ago

Verified 1d2869c6

metal : add TQ2_0 support (#26980)

ggerganov committed 5 days ago

Verified 4a84b0ad

common : auto-detect spec type from draft GGUF metadata (#26814)

aic0d3r committed 5 days ago

Verified f65e568f

spec: enable backend sampling for both dflash & dspark (#26958)

ruixiang63 committed 5 days ago

Verified 0d0bfcd4

ggml-cpu/ops: vectorize flash-attention V-cache F16 to F32 conversion (#26947)

jinzihao committed 5 days ago

Verified eeae28b6

sycl: remove separate fp32 type promotion in gemm non-oneDNN path (#26372)

icfaust committed 5 days ago

Verified 154d57af

sycl: fuse UNARY(silu|sigmoid|softplus) + MUL (#26411)

Titaniumtown committed 5 days ago

Verified 1ee1cd9b

sycl : Add DMMV ESIMD Q3_K kernel (#26251)

malsbat committed 5 days ago

Verified 8efbf65d

sycl : enhance concat to support Q4_0, Q4_1, Q5_0, Q5_1, Q8_0 (#26800)

arthw committed 5 days ago

Verified d415e65a

server: refactor + correctness fixes for metrics (#26920)

ngxson committed 5 days ago

Verified decaf508

Older