ggml-org/llama.cpp

Pull Requests Commits

use ggml_cuda_syncwarp

am17an committed 30 days ago

f0f9902d

cuda: fixes races in mmid and mmf

am17an committed 30 days ago

86e7fc4f

sycl : fix test-backend-ops CI break && restore Kronecker product FWHT support (#28016) (#28254)

philip-jingxin committed 31 days ago

Verified 4d917609

sycl: attribute device allocations by site (GGML_SYCL_MEMTRACE) (#27631)

nicois committed 31 days ago

Verified cd8cdf39

metal : add remaining fa-vec tunings for M3 (#28396)

init-22 committed 31 days ago

Verified 427291b5

ui : fix MCP image attachments not displayed in tool block (#25789) (#28089)

nachobh committed 31 days ago

Verified 85d5703a

opencl: extend the elementwise and data‐movement op coverage (#27633)

wanghqc committed 32 days ago

Verified 1548a240

opencl: add Adreno xmem SDPA path (#26331)

happyyzy committed 32 days ago

Verified 4acf4a4c

ci : move more jobs to ccache-buckets (#28375)

CISC committed 32 days ago

Verified 8b4b3558

ui: export conversations from database instead of cached store (#27432)

intel00000 committed 32 days ago

Verified 1863ac03

model : add Tencent Hy 4 (hy_v4) preview architecture support (#28127)

Little0o0 committed 32 days ago

Verified 49c0dc82

llama.cpp : bump version to 0.4.0 (#28386)

ggerganov committed 32 days ago

Verified 5266f24d

sync : ggml (#28379)

ggerganov committed 32 days ago

Verified 64a155d2

model, mtmd: fix gemma4 vision handling (#28335)

ngxson committed 32 days ago

Verified 163a4079

metal : add remaining fa-vec tunings for M3 Max (#28373)

nikwen committed 32 days ago

Verified 8f83678f

ggml : replace compile definitions with version.h.in (#28364)

danbev committed 32 days ago

Verified 86b351fd

Don't use npx inside a package.json script (#28270)

eapache committed 32 days ago

Verified d509cb1e

ggml : don't crash when backend search path can't be read (#28271)

angt committed 32 days ago

Verified 4cbe8b07

ggml : remove GGML_CUDA_PEER_MAX_BATCH_SIZE (#28177)

angt committed 32 days ago

Verified 24f5bf8a

docs : update maintainer PRs link and regenerate AUTHORS (#28365)

ggerganov committed 32 days ago

Verified a529af96

vendor: update BoringSSL to 0.20260903.0 (#28354)

cabelo committed 32 days ago

Verified 38521ec3

ci : disable failing openvino tests (#28347)

ravi9 committed 32 days ago

Verified 0ef4d560

common : make build info output stream configurable (#28322)

angt committed 32 days ago

Verified c390d0ab

ggml-cpu(s390x) : fix q5_1 uninitialized v_acc (#28332)

taronaeo committed 32 days ago

Verified 832fd6f1

src : add n_expert_used_max function (#28323)

danbev committed 32 days ago

Verified 9a4843cf

sycl: fuse rms_norm+mul+add and add+add residual chains (#27610)

newjordan committed 32 days ago

Verified 6703d789

SYCL: Refactor GGML_SYCL_ENABLE_MKL_FA to global var (#26863)

johnkarlhill committed 32 days ago

Verified f9f09f02

llama: fix whole source code rebuilt on each new commit (#28278)

ngxson committed 32 days ago

Verified d230ddd7

common/json-schema : fix GBNF grammar generation for empty object schemas (#28279)

SergeySklyarov committed 32 days ago

Verified c5a5535e

opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations (speculative decoding/MTP) (#26477)

wanghqc committed 33 days ago

Verified 95ef7fc1

Older