ggerganov/llama.cpp

Pull Requests Commits

ggerganov committed 8 hours ago

Verified 52e99548

ggerganov committed 8 hours ago

Verified 1aa98bbe

cont : more logs

ggerganov committed 8 hours ago

Verified 5beb19ad

ggerganov committed 9 hours ago

Verified 8eca1cd5

ggerganov committed 9 hours ago

Verified 0fdb83ec

cont : add <string>

ggerganov committed 9 hours ago

Verified cd8860a0

rpc : make RDMA probe diagnostics more verbose

ggerganov committed 9 hours ago

511fa698

rpc : log the actual network transport in use

ggerganov committed 9 hours ago

8d4c022e

llama : allow virtual igpu devices (#26953)

ggerganov committed 10 hours ago

Verified 4c1a0af4

server: allow accessing /metrics and /slots during llama_decode() (#27041)

ngxson committed 11 hours ago

Verified 77918caf

tests : replace personal home directory paths with generic placeholders (#27043)

jimw567 committed 14 hours ago

Verified 885c5bbe

sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (#26779)

Titaniumtown committed 16 hours ago

Verified 65091386

ggml: force single thread on wasi (#25686)

MendyBerger committed 16 hours ago

Verified c6f6a92c

sycl: fuse the gated-delta-net state writeback cpy (#26643)

Titaniumtown committed 16 hours ago

Verified 3d938853

dflash : clarify output logging of target_layer_ids (#27013)

danbev committed 17 hours ago

Verified 2bacf9ea

common: apply CPU parameters across tools (#27026)

nikwen committed 1 day ago

Verified a94d563e

ui: Refactor data-attrs constants, enum for bool strings (#27002)

ServeurpersoCom committed 1 day ago

Verified bdffafa5

refactor: Naming (#27001)

allozaur committed 1 day ago

Verified fa4ec459

ui: fix VITE_PUBLIC_SERVER variable reading (#24845)

brainrom committed 1 day ago

Verified 9c5531e2

OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (#26952)

wine99 committed 1 day ago

Verified aee56b3a

[SYCL] Support host pinned mem to improve SYCL Host-to-Device Memory Access (#26789)

arthw committed 1 day ago

Verified a97123e4

chat : fix LFM2 tool call arg name prefix ambiguity (#26960)

aldehir committed 1 day ago

Verified 2606220d

server : serve index.html with no-cache (#27006)

erusev committed 1 day ago

Verified 981184e4

spec : auto-detect mtp draft model type (#27005)

CISC committed 1 day ago

Verified 1d2869c6

metal : add TQ2_0 support (#26980)

ggerganov committed 1 day ago

Verified 4a84b0ad

common : auto-detect spec type from draft GGUF metadata (#26814)

aic0d3r committed 1 day ago

Verified f65e568f

spec: enable backend sampling for both dflash & dspark (#26958)

ruixiang63 committed 1 day ago

Verified 0d0bfcd4

ggml-cpu/ops: vectorize flash-attention V-cache F16 to F32 conversion (#26947)

jinzihao committed 1 day ago

Verified eeae28b6

sycl: remove separate fp32 type promotion in gemm non-oneDNN path (#26372)

icfaust committed 1 day ago

Verified 154d57af

sycl: fuse UNARY(silu|sigmoid|softplus) + MUL (#26411)

Titaniumtown committed 1 day ago

Verified 1ee1cd9b

Older