ggerganov/llama.cpp

Pull Requests Commits

cont : add TODO

ggerganov committed 103 days ago

978c88ba

context : perform output reorder after lazily upon access after sync

ggerganov committed 103 days ago

5e58711c

sycl: fixed semantics of block offset calculation (#14814)

Alcpz committed 103 days ago

Verified cb4a63aa

llama : fix MiniCPM inference after Granite Four changes (#14850)

jk3456a committed 103 days ago

Verified 86f5623d

docs: add libcurl-dev install hint for Linux distros (#14801)

PouyaGhahramanian committed 103 days ago

Verified 39cffdf1

metal : fix fusion across different encoders (#14849)

ggerganov committed 104 days ago

Verified 065908cb

sycl: fix undefined variable in work group size check (#14843)

djeong20 committed 104 days ago

Verified 4ec6291a

convert : text-only support for GLM-4.1V-9B-Thinking (#14823)

jacekpoplawski committed 104 days ago

Verified a12363bb

CUDA: fix overflow in FA, tune performance (#14840)

JohannesGaessler committed 104 days ago

Verified a86f52b2

CUDA: fix compilation with GGML_CUDA_F16 (#14837)

JohannesGaessler committed 104 days ago

Verified b284197d

ci : correct label refactor->refactoring (#14832)

CISC committed 104 days ago

Verified 221c0e0c

CUDA: fix quantized KV cache + multiple sequences (#14822)

JohannesGaessler committed 104 days ago

07a19e27

tests : add non-cont K,V FA tests

ggerganov committed 104 days ago

18f3b5ff

memory : handle saving/loading null layers in recurrent memory (#14675)

l3utterfly committed 104 days ago

Verified 7233358d

ggml: fix loongarch quantize_row_q8_1 error (#14827)

lixing-star committed 105 days ago

Verified 6c88b3bb

CANN: weight format to NZ for Ascend310P3 (#14407)

tqgy6 committed 105 days ago

Verified 14c28dfc

CUDA: add fused rms norm (#14800)

am17an committed 105 days ago

Verified 8c988fa4

ggml : model card yaml tab->2xspace (#14819)

csabakecskemeti committed 105 days ago

Verified acd6cb1c

vulkan: fix rms_norm_mul to handle broadcasting dim0 (#14817)

jeffbolznv committed 105 days ago

Verified 84712b60

llama : add model type detection for rwkv7 7B&14B (#14816)

MollySophia committed 105 days ago

Verified d4d1522b

imatrix: add option to display importance score statistics for a given imatrix file (#12718)

EAddario committed 105 days ago

Verified d1aa0cc5

Mtmd: add a way to select device for vision encoder (#14236)

stduhpf committed 105 days ago

Verified c8ade300

cuda : implement bf16 cpy ops and enable bf16 cont (#14763)

CISC committed 105 days ago

Verified e28c0b80

opencl: remove unreachable `return` (#14806)

lhez committed 106 days ago

Verified 8e6f8bc8

server : allow setting `--reverse-prompt` arg (#14799)

MollySophia committed 106 days ago

Verified adef8178

cuda: remove linking to cublasLt (#14790)

yeahdongcn committed 106 days ago

Verified 48b86c4f

opencl: fix `im2col` when `KW!=KH` (#14803)

CISC committed 106 days ago

Verified 38d3af1b

opencl: add conv2d kernel (#14403)

rmatif committed 106 days ago

Verified 6c9ee3b1

sycl: Fix im2col (#14797)

Rbiessy committed 106 days ago

Verified cd465d82

kleidiai: add support for get_rows (#14676)

chaxu01 committed 106 days ago

Verified 92204260

Older