ngxson/llama.cpp

Pull Requests Commits

(wip) also support yarn

ngxson committed 1 day ago

0ef788f6

model : optimize DSA RoPE, remove some ggml_concat

ngxson committed 1 day ago

dd217de3

ggml : recurrent state rollback for ggml_ssm_scan (#26623)

lnigam committed 2 days ago

Verified 1692f9e5

llama : allow virtual igpu devices (#26953)

ggerganov committed 2 days ago

Verified 4c1a0af4

server: allow accessing /metrics and /slots during llama_decode() (#27041)

ngxson committed 2 days ago

Verified 77918caf

tests : replace personal home directory paths with generic placeholders (#27043)

jimw567 committed 2 days ago

Verified 885c5bbe

sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (#26779)

Titaniumtown committed 2 days ago

Verified 65091386

ggml: force single thread on wasi (#25686)

MendyBerger committed 2 days ago

Verified c6f6a92c

sycl: fuse the gated-delta-net state writeback cpy (#26643)

Titaniumtown committed 2 days ago

Verified 3d938853

dflash : clarify output logging of target_layer_ids (#27013)

danbev committed 2 days ago

Verified 2bacf9ea

common: apply CPU parameters across tools (#27026)

nikwen committed 3 days ago

Verified a94d563e

ui: Refactor data-attrs constants, enum for bool strings (#27002)

ServeurpersoCom committed 3 days ago

Verified bdffafa5

refactor: Naming (#27001)

allozaur committed 3 days ago

Verified fa4ec459

ui: fix VITE_PUBLIC_SERVER variable reading (#24845)

brainrom committed 3 days ago

Verified 9c5531e2

OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (#26952)

wine99 committed 3 days ago

Verified aee56b3a

[SYCL] Support host pinned mem to improve SYCL Host-to-Device Memory Access (#26789)

arthw committed 3 days ago

Verified a97123e4

chat : fix LFM2 tool call arg name prefix ambiguity (#26960)

aldehir committed 3 days ago

Verified 2606220d

server : serve index.html with no-cache (#27006)

erusev committed 3 days ago

Verified 981184e4

spec : auto-detect mtp draft model type (#27005)

CISC committed 3 days ago

Verified 1d2869c6

metal : add TQ2_0 support (#26980)

ggerganov committed 3 days ago

Verified 4a84b0ad

common : auto-detect spec type from draft GGUF metadata (#26814)

aic0d3r committed 3 days ago

Verified f65e568f

spec: enable backend sampling for both dflash & dspark (#26958)

ruixiang63 committed 3 days ago

Verified 0d0bfcd4

ggml-cpu/ops: vectorize flash-attention V-cache F16 to F32 conversion (#26947)

jinzihao committed 3 days ago

Verified eeae28b6

sycl: remove separate fp32 type promotion in gemm non-oneDNN path (#26372)

icfaust committed 3 days ago

Verified 154d57af

sycl: fuse UNARY(silu|sigmoid|softplus) + MUL (#26411)

Titaniumtown committed 3 days ago

Verified 1ee1cd9b

sycl : Add DMMV ESIMD Q3_K kernel (#26251)

malsbat committed 3 days ago

Verified 8efbf65d

sycl : enhance concat to support Q4_0, Q4_1, Q5_0, Q5_1, Q8_0 (#26800)

arthw committed 3 days ago

Verified d415e65a

server: refactor + correctness fixes for metrics (#26920)

ngxson committed 3 days ago

Verified decaf508

ggml-hip : remove -funsafe-math-optimizations (#26696)

jimw567 committed 3 days ago

Verified e79e4bf6

ui: Clean up contexts, remove prop drilling from Chat Form Actions (#26951)

allozaur committed 3 days ago

Verified d86c7d62

Older