ggerganov/llama.cpp

Pull Requests Commits

mtmd : add `const` in various places (#28307)

madsmtm committed 32 days ago

Verified f45576aa

CUDA: Allow concurrent streams per split for multi-GPU (#28198)

tannerbruhn committed 32 days ago

Verified 0ba6499c

vulkan: fix FA dequant path engagement (#28190)

Nathanw1014 committed 32 days ago

Verified c7bda030

sycl : enhance the api to support peer-to-peer copy (#27550)

arthw committed 32 days ago

Verified 0df974d7

convert : skip bias_vl tensor in DeepSeek-V4 DSpark conversion (#28294)

ggerganov committed 32 days ago

Verified d646c9d1

misc : prevent RAM peaking at model loading stage (#27483)

tdakhran committed 32 days ago

Verified 5ec4eab6

sycl: reduce redundant work in Q4_K multi-column MMVQ (#27062)

Eurekatic committed 32 days ago

Verified 4aa6ffba

model: add NVIDIA Nemotron-3-Puzzle-75B-A9B (NemotronHPuzzle) support (#25444)

YanissAmz committed 32 days ago

Verified c61b98b8

mtmd: fix idefics3 preproc (#28273)

ngxson committed 32 days ago

Verified 67a17c17

finetune: fix no KV cache (#27199)

ngxson committed 32 days ago

Verified 159b7414

server : accept data: URLs for input_video and input_audio (#27735)

geckguy committed 32 days ago

Verified 9cffdcc8

ggml-hexagon: add F16 support for unary ops (#28228)

cqderek committed 32 days ago

Verified f027c4f1

mtmd: add mtmd_tokenize_from_parts() (#28250)

ngxson committed 32 days ago

Verified 73390547

metal : add fa-vec tunings for M3 (#28236)

init-22 committed 32 days ago

Verified 9cc33944

metal : fix memory query under low-memory conditions (#27701)

madsmtm committed 32 days ago

Verified 8c0b9cd0

ci : check for missing autoreleasepools (#27884)

nikwen committed 32 days ago

Verified 03dbcc53

Update ROCm to 10.0.0 release (#27803)

superm1 committed 32 days ago

Verified cff18443

model: correctly support input vision for deepseek4 (#28154)

ngxson committed 32 days ago

Verified 9400c894

ci : enable hf-jobs on server-cuda (#28258)

CISC committed 32 days ago

Verified d5fec32a

ggml-cuda : remove unused vars (#28235)

angt committed 32 days ago

Verified 3d3d7c81

common, server : enable preserve_reasoning kwarg by default, log its effective state (#28174)

ggerganov committed 32 days ago

Verified e750b887

mtmd: support DeepSeek-V4-Flash-Vision-Exp (#28133)

ngxson committed 32 days ago

Verified 7798007a

CUDA + ggml: add sparse-fa for DSV4/GLM (#27970)

am17an committed 32 days ago

Verified 8e93a977

mtmd: Fix Qwen3-tts-0.6b (#28231)

ServeurpersoCom committed 33 days ago

Verified 0f3a71be

ggml: avoid KleidiAI buffer type init on dispatch (#27891)

ac-mmi committed 33 days ago

Verified b81c99b4

hexagon: MUL_MAT and MUL_MAT_ID fusion and fixes (#28202)

max-krasnyansky committed 33 days ago

Verified 960dffab

vulkan: handle larger batch sizes (>4) efficiently for IQ3_S mat-vec (#27449)

LaurentZuijdwijk committed 33 days ago

Verified ba8818cb

vulkan : only request VK_KHR_shader_bfloat16 extension if supported (#28155)

madsmtm committed 33 days ago

Verified 56dd8150

ggml-cpu : conditionally add SpacemiT IME kernel sources (#27961)

alanhc committed 33 days ago

Verified 2637dfe3

opencl: fix out‐of‐bound reads in the Adreno image kernels (#27632)

wanghqc committed 33 days ago

Verified 43d87ff2

Newer Older