ggerganov/llama.cpp

Pull Requests Commits

spec : avoid binding reference to null pointer

ggerganov committed 7 hours ago

Verified f3452dcb

vulkan : dequant q8_0 KV once in coopmat1 (#25494)

Nathanw1014 committed 10 hours ago

Verified dc72703f

vulkan: add null checks in ggml_vk_queue_command_pools_cleanup (#27353)

jetsontan committed 10 hours ago

Verified b95502ba

Revert "common: share thread pools when `n_threads` differ (#27138)" (#27337)

nikwen committed 10 hours ago

Verified 3e734467

model : GraniteSWAForCausalLM / GraniteMoeSWAForCausalLM (#25505)

gabe-l-hart committed 11 hours ago

Verified 7221e24f

sycl: report zero devices instead of aborting when the host has none (#27291)

Titaniumtown committed 11 hours ago

Verified 6cc504a2

ci : add release attestation url (#27389)

CISC committed 11 hours ago

Verified 01ac3ad7

models : remove duplicate metadata load (#27378)

CISC committed 11 hours ago

Verified 2e92ecd0

ci : re-enable release dependency for sycl (#27385)

CISC committed 12 hours ago

Verified 645ca283

ggml: add ggml_rope_set_offset (+ metal support) (#27120)

ngxson committed 13 hours ago

Verified fe8156f7

ui: read persisted settings before the API key probe (#27365)

ServeurpersoCom committed 13 hours ago

Verified 77acca43

mtmd: add mtmd_bitmap_set_mergeable (#27348)

ngxson committed 14 hours ago

Verified 95c409c1

metal : dequantize q8_0 using packed types (#27370)

ggerganov committed 14 hours ago

Verified 8ef78e64

server: add dedup-cache-models preset option (#27346)

ngxson committed 16 hours ago

Verified ee4c505a

vulkan: tiled transpose for 0<->2 permuted CONT (#26585)

kh0pper committed 17 hours ago

Verified 98d1e92c

ggml-webgpu: add mulmat with overlapping src0/src1 (e.g., for minimax-01) (#27321)

yomaytk committed 18 hours ago

Verified 5112b973

ci : add attestation for signed release artifacts (#25933)

quartzjer committed 18 hours ago

Verified 0adcc3bb

tests: skip test-unicode build on win32/BUILD_SHARED_LIBS (#27336)

jeffbolznv committed 19 hours ago

Verified 79fe7991

gguf-py : add size guards to GGUFReader (#27188)

oakkaya committed 19 hours ago

Verified 0329fcda

server: (cosmetic) do not print cmd_child_to_router messages [no release] (#27347)

ngxson committed 1 day ago

Verified 6d054983

opencl: fix WAR race in the generic FA tile kernels when the WG spans subgroups (#26434)

wanghqc committed 1 day ago

Verified 60addddf

mtmd: deepseek-ocr SAM ggml_conv_2d with the im2col kept in F32 (#26727)

sfallah committed 1 day ago

Verified 9731ad3f

RPC: populate use_count to enable fusion inside backends (#27142)

am17an committed 1 day ago

Verified af517262

ui: Services consolidation refactor (#27239)

allozaur committed 1 day ago

Verified 3dc7285b

ui: Stores consolidation refactor (#27238)

allozaur committed 1 day ago

Verified fdf4c646

common: share thread pools when `n_threads` differ (#27138)

nikwen committed 1 day ago

Verified 04b56914

quant : Optimise memory usage by evicting weights after processing each layer (#22877)

EAddario committed 1 day ago

Verified 05967042

sycl: honor GGML_HINT_SRC0_IS_HADAMARD (#27298)

Titaniumtown committed 1 day ago

Verified 0882c7bc

unicode : include '~' in collapsed symbol class (#26972)

tarruda committed 1 day ago

Verified afd439df

readme : update status badges + regen AUTHORS (#27317)

ggerganov committed 1 day ago

Verified 169e4a7f

Older