ggml-org/llama.cpp

Pull Requests Commits

bench,common : add CPU extra buffer types

ggerganov committed 50 days ago

Verified fb371c18

opencl : add ops docs (#14910)

lhez committed 50 days ago

Verified 8ad7b3e6

test-backend-ops : extend test case filtering (#14865)

tlemo committed 50 days ago

Verified bda62193

llama-bench : use local GPUs along with RPC servers (#14917)

rgerganov committed 50 days ago

Verified c556418b

ggml-cpu : deduplicate scalar implementations (#14897)

xctan committed 50 days ago

Verified db16e283

SYCL: Add set_rows support for quantized types (#14883)

qnixsynapse committed 50 days ago

Verified cd1fce6d

mtmd : add support for Voxtral (#14862)

ngxson committed 50 days ago

Verified 00fa15fe

CUDA: fix pointer incrementation in FA (#14916)

JohannesGaessler committed 50 days ago

Verified 946b1f68

model : add support for SmallThinker series (#14898)

wdl339 committed 50 days ago

Verified 6c6e397a

sycl: refactor quantization to q8_1 (#14815)

Alcpz committed 50 days ago

Verified afc0e896

ops : update BLAS (#14914)

ggerganov committed 50 days ago

Verified a5771c9e

ops : update Metal (#14912)

ggerganov committed 51 days ago

Verified c35f9eaf

ggerganov committed 51 days ago

1f45f289

cmake : Indent ggml-config.cmake (ggml/1310)

dg0yt committed 51 days ago

613c5095

quantize : update README.md (#14905)

EAddario committed 51 days ago

Verified 7f975995

vulkan: add ops docs (#14900)

0cc4m committed 51 days ago

Verified bf78f543

SYCL: add ops doc (#14901)

qnixsynapse committed 51 days ago

Verified bbfc8492

llama : clarify comment about pp and tg graphs [no ci] (#14895)

danbev committed 51 days ago

Verified ca0ef2dd

vulkan : add fp16 support for the conv_2d kernel (#14872)

Green-Sky committed 51 days ago

Verified 89d10295

vulkan: skip empty set_rows to avoid invalid API usage (#14860)

jeffbolznv committed 51 days ago

Verified f1a4e72d

model : make rope_yarn_log_mul optional for deepseek2 (#14896)

gabriellarson committed 51 days ago

Verified 4762ad73

llama : fix kq_scale for the attention layers of PLaMo2 (#14892)

mitmul committed 51 days ago

Verified 1dc9614e

Docs: add instructions for adding backends (#14889)

am17an committed 52 days ago

Verified 446595b9

HIP: Enable Matrix cores for MMQ Kernels, Enable stream-K for CDNA 3 (#14624)

deepsek committed 52 days ago

Verified 66906cd8

CANN: Implement GLU ops (#14884)

hipudding committed 52 days ago

Verified 11dd5a44

musa: fix build warnings (unused variable) (#14869)

yeahdongcn committed 53 days ago

Verified 9b8f3c6c

ggml-cpu : disable GGML_NNPA by default due to instability (#14880)

taronaeo committed 53 days ago

Verified c7f3169c

metal: SSM_SCAN performance (#14743)

gabe-l-hart committed 53 days ago

Verified 793c0d7f

opencl: add fused `rms_norm_mul` (#14841)

lhez committed 53 days ago

Verified ce111d39

docs : update HOWTO‑add‑model.md for ModelBase and new model classes (#14874)

wooksong committed 53 days ago

Verified e7fecba9

Older