ggerganov/llama.cpp

Pull Requests Commits

sched : fix multiple evaluations of the same graph with pipeline parallelism

slaren committed 77 days ago

a124399f

context : perform output reorder lazily upon access after sync (#14853)

ggerganov committed 77 days ago

Verified e4868d16

chat : fix kimi-k2 chat template (#14852)

ngxson committed 77 days ago

Verified 820de57d

sycl: fixed semantics of block offset calculation (#14814)

Alcpz committed 77 days ago

Verified cb4a63aa

llama : fix MiniCPM inference after Granite Four changes (#14850)

jk3456a committed 77 days ago

Verified 86f5623d

docs: add libcurl-dev install hint for Linux distros (#14801)

PouyaGhahramanian committed 77 days ago

Verified 39cffdf1

metal : fix fusion across different encoders (#14849)

ggerganov committed 77 days ago

Verified 065908cb

sycl: fix undefined variable in work group size check (#14843)

djeong20 committed 78 days ago

Verified 4ec6291a

convert : text-only support for GLM-4.1V-9B-Thinking (#14823)

jacekpoplawski committed 78 days ago

Verified a12363bb

CUDA: fix overflow in FA, tune performance (#14840)

JohannesGaessler committed 78 days ago

Verified a86f52b2

CUDA: fix compilation with GGML_CUDA_F16 (#14837)

JohannesGaessler committed 78 days ago

Verified b284197d

ci : correct label refactor->refactoring (#14832)

CISC committed 78 days ago

Verified 221c0e0c

CUDA: fix quantized KV cache + multiple sequences (#14822)

JohannesGaessler committed 78 days ago

07a19e27

tests : add non-cont K,V FA tests

ggerganov committed 78 days ago

18f3b5ff

memory : handle saving/loading null layers in recurrent memory (#14675)

l3utterfly committed 78 days ago

Verified 7233358d

ggml: fix loongarch quantize_row_q8_1 error (#14827)

lixing-star committed 78 days ago

Verified 6c88b3bb

CANN: weight format to NZ for Ascend310P3 (#14407)

tqgy6 committed 79 days ago

Verified 14c28dfc

CUDA: add fused rms norm (#14800)

am17an committed 79 days ago

Verified 8c988fa4

ggml : model card yaml tab->2xspace (#14819)

csabakecskemeti committed 79 days ago

Verified acd6cb1c

vulkan: fix rms_norm_mul to handle broadcasting dim0 (#14817)

jeffbolznv committed 79 days ago

Verified 84712b60

llama : add model type detection for rwkv7 7B&14B (#14816)

MollySophia committed 79 days ago

Verified d4d1522b

imatrix: add option to display importance score statistics for a given imatrix file (#12718)

EAddario committed 79 days ago

Verified d1aa0cc5

Mtmd: add a way to select device for vision encoder (#14236)

stduhpf committed 79 days ago

Verified c8ade300

cuda : implement bf16 cpy ops and enable bf16 cont (#14763)

CISC committed 79 days ago

Verified e28c0b80

opencl: remove unreachable `return` (#14806)

lhez committed 79 days ago

Verified 8e6f8bc8

server : allow setting `--reverse-prompt` arg (#14799)

MollySophia committed 80 days ago

Verified adef8178

cuda: remove linking to cublasLt (#14790)

yeahdongcn committed 80 days ago

Verified 48b86c4f

opencl: fix `im2col` when `KW!=KH` (#14803)

CISC committed 80 days ago

Verified 38d3af1b

opencl: add conv2d kernel (#14403)

rmatif committed 80 days ago

Verified 6c9ee3b1

sycl: Fix im2col (#14797)

Rbiessy committed 80 days ago

Verified cd465d82

Older