ggml-org/llama.cpp

Pull Requests Commits

ui : model id grammar for sidecars, quants and capability parsing

allozaur committed 5 days ago

0809c495

ui : type-safe API types, fetch helpers and download-ready models store plumbing

allozaur committed 5 days ago

936adc32

server : fix deadlock when removing a finished download

allozaur committed 5 days ago

cdc2053b

common : resolve <quant>-<sidecar> download tags and list cached sidecars

allozaur committed 5 days ago

a56cfe1b

ci : bump ty to 0.0.78 (#28548)

CISC committed 5 days ago

Verified 67672dc5

tests : initialize the L2_NORM batch array (#28553)

ServeurpersoCom committed 5 days ago

Verified f114f91f

Revert "CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#24546)" (#28551)

pwilkin committed 5 days ago

Verified e71b8051

nix : update deprecated expressions (#28145)

ZhaolunYin committed 5 days ago

Verified ccc3646c

webgpu: format the GET_ROWS case block (#28542)

ServeurpersoCom committed 5 days ago

Verified c0b1871b

server: fix LRU hang on multiple requests same model (#28539)

ngxson committed 5 days ago

Verified 160bd031

sycl: add a batched L2_NORM kernel (#28222)

Titaniumtown committed 5 days ago

Verified dbeb3754

vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/PRE/POST) (#26578)

kh0pper committed 5 days ago

Verified 7a333e72

CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#24546)

ravel7524 committed 5 days ago

Verified 0c963452

ggml: add gfx90c HIP support (#26454)

AuroraRAS committed 5 days ago

Verified 47359973

convert : refactor Hy4-preview conversion - move HC tensor mapping to the global map (#28451)

fairydreaming committed 5 days ago

Verified d23c47f2

CUDA: branchless Q4_K/Q5_K unpack to speed up mmvq, L2 prefetch on DGX Spark (#26705)

praneshgo committed 5 days ago

Verified 73ab7599

vulkan: support type-aligned GET_ROWS (#28253)

jeffbolznv committed 5 days ago

Verified 0cae4306

examples : print ggml_version and ggml_commit in test-cmake [no ci] (#28538)

danbev committed 6 days ago

Verified 1173700b

caps : recheck typed content if template checks for string (#28511)

CISC committed 6 days ago

Verified 5202104b

convert : write explicit recurrent_layers for Qwen3-Next / Qwen3.5 (#28208)

devvexus committed 6 days ago

Verified 9a757058

ggml-cuda: fix divergent barrier in f16 flash attention (#27870)

siavashnorouzi committed 6 days ago

Verified b74f590e

ggml: allow backend inputs to not create another split (#28387)

am17an committed 6 days ago

Verified 992cb503

vulkan: rms_norm fusion opportunities (#28024)

jeffbolznv committed 6 days ago

Verified 9ac8c408

ci : add container image checking and tagging (wip) (#28394)

danbev committed 6 days ago

Verified 2092353c

vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (#27765)

Anjielon committed 6 days ago

Verified 8fe90e1f

convert : add `--fuse-qkv` flag to fuse Q/K/V into QKV during HF-to-GGUF conversion (#22780)

JoursBleu committed 6 days ago

Verified 465e49b9

models : fix GDN normalization from `max` to `rsqrt` (#28068)

danielhanchen committed 6 days ago

Verified 5fdfa628

[Model] Support for Spark2_5ForCausalLM implementation (#27868)

KnightYao committed 6 days ago

Verified 3ad1ba73

opencl: properly choose weights pack for q4_K, q5_K mul_mat (#28402)

lhez committed 6 days ago

Verified d03efa5d

cuda: fixes races in mmid and mmf (#28475)

am17an committed 6 days ago

Verified 73a43d1f

Older