ggml-org/llama.cpp

Pull Requests Commits

context : relax on-device seq-copy chunk alignment

ggerganov committed 25 days ago

a0d616e9

tests : fix dsv4 save-load n_stream mismatch

ggerganov committed 25 days ago

78898478

tests : use 64 indexer heads for deepseek4

ggerganov committed 25 days ago

a538337f

tests : add --help and document -o in test-llama-archs

ggerganov committed 25 days ago

f3e1b82b

tests : match dummy DSA indexer to fused Lightning Indexer kernel

ggerganov committed 25 days ago

571bf769

tests : run test-save-load-state across all architectures

ggerganov committed 25 days ago

46ca1855

vulkan: warptiles currently assume warp sizes <= 64, clamp to work around larger warps (#27726)

0cc4m committed 25 days ago

Verified 5e6a37cb

Implemented vulkan cross_entropy_loss and cross_entropy_loss_back (#27216)

PranavUttarkar committed 25 days ago

Verified bf942164

rpc : implement event and async backend APIs (#18626)

rgerganov committed 25 days ago

Verified d0132a68

ci: Clean up UI builds from releases (#27706)

allozaur committed 25 days ago

Verified 4d19b287

cuda: unblock mmq for MoE on sm_60 (#26264)

dfriehs committed 25 days ago

Verified fc35562b

ci : make cache bucket public (#27728)

CISC committed 25 days ago

Verified da9b5d68

conversion : fix Nemotron 3.5 Lightning layers (#27729)

danbev committed 25 days ago

Verified dac869b0

ggml-metal: add chunked SSD MMA for Mamba-2 prefill optimization (#26647)

dpantaleoni committed 25 days ago

Verified 11cd9884

ggml-meta: propagate buffer usage and call init on the new tensors (#27586)

max-krasnyansky committed 26 days ago

Verified 5d5cb4c3

kleidiai: Rework KleidiAI Build System/Integration (#26077)

JonathanC-ARM committed 26 days ago

Verified d222767c

ci : update OS used for ROCM to Ubuntu 24.04 (#27681)

superm1 committed 26 days ago

Verified eab8ee41

rpc: support apple RDMA as an RPC transport (#26421)

ryan5rdx committed 26 days ago

Verified b114b473

devops: use GGML_NATIVE=OFF for OpenVINO (#27338)

krzsztf committed 26 days ago

Verified 0a5ac49b

server : reject prefilled assistant messages with tool calls (#27626)

kyo-zzz committed 26 days ago

Verified 1729ed53

chat : scope qwen3-coder workarounds (#27679)

aldehir committed 26 days ago

Verified 0cc5b149

ci : store ccache on HF buckets (test with cuda-ubuntu for now) (#27699)

CISC committed 26 days ago

Verified 790b5713

ui: ESLint config updates (#27700)

allozaur committed 26 days ago

Verified f1357e49

metal : null-check buffer alloc to fix OOM crash (#25371)

ykhrustalev committed 26 days ago

Verified 3737e413

llama.cpp : bump version to 0.3.0 (#27696)

ggerganov committed 26 days ago

Verified c1d0e7a0

ggerganov committed 26 days ago

81191aff

ggml : bump version to 0.22.0 (ggml/1607)

ggerganov committed 26 days ago

93882361

grammar : parse \- in char classes as literal hyphen (#27591)

NIXKnight committed 27 days ago

Verified eb25b726

sycl : mark tq2_0 as not supported (#27660)

arthw committed 27 days ago

Verified 814d84bc

webgpu : fix handling of infinity values during ARGSORT and TOP_K (#27538)

fairydreaming committed 27 days ago

Verified 5ea87dda

Older