ggerganov/llama.cpp

Pull Requests Commits

metal : adjust .get_alloc_size to be alloc friendly

ggerganov committed 16 days ago

Verified f0076dc5

ci : avoid manual updates of docs/ops.md (#16663)

CISC committed 16 days ago

Verified cec5edbc

ci: include s390x release binaries (#16648)

taronaeo committed 16 days ago

Verified fcb235b4

CODEOWNERS: update for ggml-cuda/mmf (#16660)

am17an committed 16 days ago

Verified 55754beb

HIP: fix GPU_TARGETS (#16642)

JohannesGaessler committed 17 days ago

Verified ee09828c

vulkan: Implement topk_moe fused shader, ported from CUDA (#16641)

jeffbolznv committed 17 days ago

Verified e56abd20

CUDA: use registers instead of smem in topk-moe (#16647)

am17an committed 17 days ago

Verified 38355c6c

opencl: transposed gemm/gemv moe kernel with mxfp4,f32 (#16602)

shawngu-quic committed 18 days ago

Verified 81387858

llama-model: fix insonsistent ctxs <-> bufs order (#16581)

JohannesGaessler committed 18 days ago

Verified 66b0dbcb

rpc : report actual free memory (#16616)

rgerganov committed 18 days ago

Verified 41386cf3

vulkan: Add State Space Model (SSM) Operations Support (#16463)

giuseppe committed 18 days ago

Verified 3d4e86bb

ggml : fix SpaceMit IME array out-of-bounds in task assignment (#16629)

muggle-stack committed 18 days ago

Verified 342c728d

webui: reorganize settings layout (#16607)

ServeurpersoCom committed 18 days ago

Verified ababae7e

vulkan: fix debug build (add_rms_len/data not found) (#16624)

jeffbolznv committed 18 days ago

Verified b1949159

metal : add `CONV_TRANSPOSE_2D` (#16542)

iliailmer committed 18 days ago

Verified 9ad4f193

grammar : use int64_t to avoid int overflows in int schema to grammar conversion logic (#16626)

ochafik committed 18 days ago

Verified 79967ec5

SYCL SET operator optimized for F32 tensors (#16350)

GittyBurstein committed 18 days ago

Verified ceff6bb2

mtmd : support home-cooked Mistral Small Omni (#14928)

ngxson committed 19 days ago

Verified 1bb4f433

fix: added a normalization step for MathJax-style \[\] and \(\) delimiters (#16599)

ServeurpersoCom committed 19 days ago

Verified 683fa6ba

sycl : add ARANGE operator (#16362)

GittyBurstein committed 19 days ago

Verified b22572e9

CANN: format code using .clang-format (#15863)

noemotiovon committed 19 days ago

Verified 7a50cf38

common : Update the docs on -t --threads (#16236)

takasurazeem committed 19 days ago

Verified 6f5d9246

ggml-cpu: replace putenv with setenv for const-correctness (#16573)

otegami committed 19 days ago

Verified adc9b60f

SYCL: Add GGML_OP_MEAN operator support (#16009)

yael-works committed 19 days ago

Verified ee50ee1e

gguf-py : add support for endian conversion of BF16 data (#16594)

AlekseiNikiforovIBM committed 20 days ago

Verified 7adc79c0

cpu : add FLOOR, CEIL, ROUND and TRUNC unary operators (#16083)

safranowith committed 20 days ago

Verified 466c1911

opencl: add q8_0 mm support (#16469)

lhez committed 20 days ago

Verified 0cb7a068

opencl: fix FA for f32 (#16584)

lhez committed 20 days ago

Verified d93f8439

Add server-driven parameter defaults and syncing (#16515)

allozaur committed 20 days ago

Verified f9fb33f2

metal: optimise `GGML_OP_SUM` (#16559)

cern1710 committed 20 days ago

Verified f4ce81c4

Older