ggml-org/llama.cpp

Pull Requests Commits

ggml-meta: make sure to call init_tensor for all new tensors

max-krasnyansky committed 9 days ago

9d74f019

backend: propagate buffer usage in meta backend

max-krasnyansky committed 9 days ago

61971124

metal: implement DSv4 Lightning Indexer (#25893)

tarruda committed 9 days ago

Verified 1464c62d

metal : add SILU_BACK (#25982)

Blackcyan30 committed 9 days ago

Verified 221f0f63

metal : add F16 support for bin ops (#26465)

ggerganov committed 9 days ago

Verified 9d21b57f

opencl: limit local workgroup size for GLU operation (#26383)

mgroeber9110 committed 9 days ago

Verified 0ab9d6fe

metal: implement DeepSeek V4 hyper-connections (#26459)

ggerganov committed 9 days ago

Verified fffbcbdb

common: support the DSpark sidecar resolution (#26458)

ServeurpersoCom committed 9 days ago

Verified bb4e0e1b

convert: add option to create separate dspark GGUF (#26452)

am17an committed 9 days ago

Verified 3581ba0c

opencl: bugfix increment ref_count in ggml_backend_opencl_init() (#26162)

akleine committed 9 days ago

Verified c745be2a

DeepseekV4 MTP + DSpark (#25784)

am17an committed 9 days ago

Verified 596a5795

chat : add qwen3 specialized parser (#26252)

aldehir committed 9 days ago

Verified f5919bf4

sycl: fix classification of iGPUs (#26105)

KyleHagy committed 9 days ago

Verified 272700b3

model : load MiMo V2 MTP tensors only if used (#26412)

CISC committed 9 days ago

Verified 75587a05

ggml-webgpu: add support for f16 repeat (#26307)

yomaytk committed 10 days ago

Verified 7a2db1a0

test: fix some CI errors (#26415)

ngxson committed 10 days ago

Verified 11924d4c

vulkan: extend topk_moe fusion to support sqrt(softplus) (#26124)

jeffbolznv committed 10 days ago

Verified a7a6d0d2

vendor : update BoringSSL to 0.20260730.0 (#26353)

cabelo committed 10 days ago

Verified 815a2a59

agents: clarify comment style and jinja knowledge (#26405)

ngxson committed 10 days ago

Verified 89482bd6

cli : persist reasoning_content in chat history (#26362)

ramicaza committed 10 days ago

Verified c629da56

mtmd: add minicpmv46 downsample (#25993)

tc-mb committed 10 days ago

Verified de699957

chat : enable tool call in thinking for DS4 (#26269)

pwilkin committed 11 days ago

Verified ddd4ec14

vulkan: add POOL_1D op (#25431)

AnandPatil1 committed 11 days ago

Verified 876a4321

vulkan: Introduce driver version check for Windows Intel GPU to mitigate crashing (#25192)

rillomas committed 11 days ago

Verified eb41d503

mtmd: add n_embd_head (#26342)

ngxson committed 11 days ago

Verified db7d8b24

Support rotated kv cache quant (#26180)

timkhronos committed 11 days ago

Verified a09d8abf

llama : load MTP tensors only if they are really used (#26296)

fairydreaming committed 11 days ago

Verified 82dbc4f0

vulkan: update vulkan sdk to 1.4.357.0 (#26303)

jeffbolznv committed 11 days ago

Verified 6f3c0a79

server: correct accepted tokens when need draft token replay (#26320)

ruixiang63 committed 11 days ago

Verified 00054751

cuda: extract Q2_0 elements via __byte_perm (#25603)

dfriehs committed 11 days ago

Verified 15e755f3

Older