ggerganov/llama.cpp

Pull Requests Commits

rpc: bump major version

am17an committed 17 days ago

bfa00faa

add TODO to simplify logic

am17an committed 17 days ago

f6ae027e

remove meta backend change

am17an committed 17 days ago

7e5e1cb2

cont: stop spinning dispatcher thread

am17an committed 17 days ago

Verified 2ab5211e

cont : fix conflict

ggerganov committed 17 days ago

Verified 686d4397

move graph_uids to rpc_dispatcher

am17an committed 17 days ago

Verified 99a227fc

fix flush for apple rdma

am17an committed 17 days ago

Verified aecaaaca

rpc: allow -sm tensor

am17an committed 17 days ago

Verified 27e1fb58

llama: fix k-pool scatter data race on shared sequences (#29994)

ServeurpersoCom committed 17 days ago

Verified 43fe9c64

hexagon: ssm-conv updates (#29971)

tboinovski1 committed 18 days ago

Verified 5e03bdd8

hexagon: add pool op support (#29995)

aparmp-quic committed 18 days ago

Verified 50569eb8

ci : add 1accel label [no ci] (#30016)

CISC committed 18 days ago

Verified 7049ff0c

ci : skip container re-tagging when Require Docker is disabled (#30008)

ggerganov committed 18 days ago

Verified c2503049

hexagon: matmul and flash-atten scalability updates (#29974)

max-krasnyansky committed 18 days ago

Verified 8345f333

llama.cpp : bump version to 0.6.0 (#29997)

ggerganov committed 18 days ago

Verified d8123504

common, server : report model input/output modalities in GET /models (#29987)

angt committed 18 days ago

Verified 4d60b4d0

ggerganov committed 18 days ago

c06f8416

ggml : bump version to 0.26.0 (ggml/1652)

ggerganov committed 18 days ago

f05c8b27

CUDA: make the alloc_deps check batch independent (#29986)

am17an committed 18 days ago

Verified e117148a

vulkan: fix Flash Attention shmem write out of bounds (#29988)

0cc4m committed 18 days ago

Verified 6c59c400

vulkan: revert mul_mat_id tile selection PR #29182 (#29936)

virajwad committed 18 days ago

Verified 3c9e747f

cuda: use the vector lightning indexer kernel on MUSA (#29990)

ServeurpersoCom committed 18 days ago

Verified b809b886

ci : add "Require Docker" flag to make-release workflow (#29989)

ggerganov committed 18 days ago

Verified 994e8f22

webui: Use toLocaleString() format consistently across chat message statistics (#27990)

grivera64 committed 18 days ago

Verified 9d853bb3

ci : disable failing test on virtual Metal device (#29993)

ggerganov committed 18 days ago

Verified 8f9ae20c

server: support vision input for Clef (#29969)

ngxson committed 18 days ago

Verified 9871df59

CUDA: Optimize accumulation in mmq for NVFP4 type (#29857)

kmorennv committed 18 days ago

Verified 8b2fbaf3

ci : disable unused qemu in docker build (#29984)

CISC committed 18 days ago

Verified 2ed93db4

server: reject partial media truncation (#24076)

he-yufeng committed 18 days ago

Verified 8e164219

vulkan: fix stale prealloc_y reuse across flash attention and soft_max (#29591)

fxgsell committed 18 days ago

Verified 806eee98

Older