ggerganov/llama.cpp

Pull Requests Commits

set coarser granularity for head splits

am17an committed 69 days ago

7c26c915

DSV4: sm tensor

am17an committed 69 days ago

7b07e05c

llama : allow virtual igpu devices (#26953)

ggerganov committed 70 days ago

Verified 4c1a0af4

server: allow accessing /metrics and /slots during llama_decode() (#27041)

ngxson committed 70 days ago

Verified 77918caf

tests : replace personal home directory paths with generic placeholders (#27043)

jimw567 committed 70 days ago

Verified 885c5bbe

sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (#26779)

Titaniumtown committed 70 days ago

Verified 65091386

ggml: force single thread on wasi (#25686)

MendyBerger committed 70 days ago

Verified c6f6a92c

sycl: fuse the gated-delta-net state writeback cpy (#26643)

Titaniumtown committed 70 days ago

Verified 3d938853

dflash : clarify output logging of target_layer_ids (#27013)

danbev committed 70 days ago

Verified 2bacf9ea

common: apply CPU parameters across tools (#27026)

nikwen committed 70 days ago

Verified a94d563e

ui: Refactor data-attrs constants, enum for bool strings (#27002)

ServeurpersoCom committed 70 days ago

Verified bdffafa5

refactor: Naming (#27001)

allozaur committed 70 days ago

Verified fa4ec459

ui: fix VITE_PUBLIC_SERVER variable reading (#24845)

brainrom committed 70 days ago

Verified 9c5531e2

OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (#26952)

wine99 committed 70 days ago

Verified aee56b3a

[SYCL] Support host pinned mem to improve SYCL Host-to-Device Memory Access (#26789)

arthw committed 70 days ago

Verified a97123e4

chat : fix LFM2 tool call arg name prefix ambiguity (#26960)

aldehir committed 70 days ago

Verified 2606220d

server : serve index.html with no-cache (#27006)

erusev committed 70 days ago

Verified 981184e4

spec : auto-detect mtp draft model type (#27005)

CISC committed 71 days ago

Verified 1d2869c6

metal : add TQ2_0 support (#26980)

ggerganov committed 71 days ago

Verified 4a84b0ad

common : auto-detect spec type from draft GGUF metadata (#26814)

aic0d3r committed 71 days ago

Verified f65e568f

spec: enable backend sampling for both dflash & dspark (#26958)

ruixiang63 committed 71 days ago

Verified 0d0bfcd4

ggml-cpu/ops: vectorize flash-attention V-cache F16 to F32 conversion (#26947)

jinzihao committed 71 days ago

Verified eeae28b6

sycl: remove separate fp32 type promotion in gemm non-oneDNN path (#26372)

icfaust committed 71 days ago

Verified 154d57af

sycl: fuse UNARY(silu|sigmoid|softplus) + MUL (#26411)

Titaniumtown committed 71 days ago

Verified 1ee1cd9b

sycl : Add DMMV ESIMD Q3_K kernel (#26251)

malsbat committed 71 days ago

Verified 8efbf65d

sycl : enhance concat to support Q4_0, Q4_1, Q5_0, Q5_1, Q8_0 (#26800)

arthw committed 71 days ago

Verified d415e65a

server: refactor + correctness fixes for metrics (#26920)

ngxson committed 71 days ago

Verified decaf508

ggml-hip : remove -funsafe-math-optimizations (#26696)

jimw567 committed 71 days ago

Verified e79e4bf6

ui: Clean up contexts, remove prop drilling from Chat Form Actions (#26951)

allozaur committed 71 days ago

Verified d86c7d62

ui: Move `styles/` to `$lib` scope (#26950)

allozaur committed 71 days ago

Verified f2efd641

Older