ggerganov/llama.cpp

Pull Requests Commits

mtmd: propagate video ID to bitmap

ngxson committed 31 days ago

e5d72461

vulkan : fuse UNARY(GELU|SIGMOID|SILU|SOFTPLUS) + MUL (#27220)

Ankk98 committed 31 days ago

Verified 64e9bceb

Fix Vulkan-Hpp handle usage on 32-bit targets. (#22892)

miyanyan committed 31 days ago

Verified f014bfef

chat : split specialized parsers into common/parsers (#27764)

pwilkin committed 31 days ago

Verified 895c045f

opencl: properly handle non-contiguous inputs to conv2d (#28503)

lhez committed 31 days ago

Verified 7d701b59

ggml : update ggml_prec specification (#26675)

ggerganov committed 31 days ago

Verified 5a6caa05

model : support Kimi-K3 recurrent-state rollback (#28466)

soulmachine committed 31 days ago

Verified 9dcf84e5

hexagon: add RELU and LEAKY_RELU ops (#28585)

tboinovski1 committed 31 days ago

Verified 050dde50

ci : bump ty to 0.0.78 (#28548)

CISC committed 32 days ago

Verified 67672dc5

tests : initialize the L2_NORM batch array (#28553)

ServeurpersoCom committed 32 days ago

Verified f114f91f

Revert "CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#24546)" (#28551)

pwilkin committed 32 days ago

Verified e71b8051

nix : update deprecated expressions (#28145)

ZhaolunYin committed 32 days ago

Verified ccc3646c

webgpu: format the GET_ROWS case block (#28542)

ServeurpersoCom committed 32 days ago

Verified c0b1871b

server: fix LRU hang on multiple requests same model (#28539)

ngxson committed 32 days ago

Verified 160bd031

sycl: add a batched L2_NORM kernel (#28222)

Titaniumtown committed 32 days ago

Verified dbeb3754

vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/PRE/POST) (#26578)

kh0pper committed 32 days ago

Verified 7a333e72

CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#24546)

ravel7524 committed 32 days ago

Verified 0c963452

ggml: add gfx90c HIP support (#26454)

AuroraRAS committed 32 days ago

Verified 47359973

convert : refactor Hy4-preview conversion - move HC tensor mapping to the global map (#28451)

fairydreaming committed 32 days ago

Verified d23c47f2

CUDA: branchless Q4_K/Q5_K unpack to speed up mmvq, L2 prefetch on DGX Spark (#26705)

praneshgo committed 32 days ago

Verified 73ab7599

vulkan: support type-aligned GET_ROWS (#28253)

jeffbolznv committed 32 days ago

Verified 0cae4306

examples : print ggml_version and ggml_commit in test-cmake [no ci] (#28538)

danbev committed 32 days ago

Verified 1173700b

caps : recheck typed content if template checks for string (#28511)

CISC committed 32 days ago

Verified 5202104b

convert : write explicit recurrent_layers for Qwen3-Next / Qwen3.5 (#28208)

devvexus committed 32 days ago

Verified 9a757058

ggml-cuda: fix divergent barrier in f16 flash attention (#27870)

siavashnorouzi committed 32 days ago

Verified b74f590e

ggml: allow backend inputs to not create another split (#28387)

am17an committed 32 days ago

Verified 992cb503

vulkan: rms_norm fusion opportunities (#28024)

jeffbolznv committed 32 days ago

Verified 9ac8c408

ci : add container image checking and tagging (wip) (#28394)

danbev committed 32 days ago

Verified 2092353c

vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (#27765)

Anjielon committed 32 days ago

Verified 8fe90e1f

convert : add `--fuse-qkv` flag to fuse Q/K/V into QKV during HF-to-GGUF conversion (#22780)

JoursBleu committed 33 days ago

Verified 465e49b9

Older