ggerganov/llama.cpp

Pull Requests Commits

tests : add non-cont K,V FA tests

ggerganov committed 46 days ago

18f3b5ff

memory : handle saving/loading null layers in recurrent memory (#14675)

l3utterfly committed 46 days ago

Verified 7233358d

ggml: fix loongarch quantize_row_q8_1 error (#14827)

lixing-star committed 46 days ago

Verified 6c88b3bb

CANN: weight format to NZ for Ascend310P3 (#14407)

tqgy6 committed 46 days ago

Verified 14c28dfc

CUDA: add fused rms norm (#14800)

am17an committed 46 days ago

Verified 8c988fa4

ggml : model card yaml tab->2xspace (#14819)

csabakecskemeti committed 46 days ago

Verified acd6cb1c

vulkan: fix rms_norm_mul to handle broadcasting dim0 (#14817)

jeffbolznv committed 46 days ago

Verified 84712b60

llama : add model type detection for rwkv7 7B&14B (#14816)

MollySophia committed 46 days ago

Verified d4d1522b

imatrix: add option to display importance score statistics for a given imatrix file (#12718)

EAddario committed 46 days ago

Verified d1aa0cc5

Mtmd: add a way to select device for vision encoder (#14236)

stduhpf committed 47 days ago

Verified c8ade300

cuda : implement bf16 cpy ops and enable bf16 cont (#14763)

CISC committed 47 days ago

Verified e28c0b80

opencl: remove unreachable `return` (#14806)

lhez committed 47 days ago

Verified 8e6f8bc8

server : allow setting `--reverse-prompt` arg (#14799)

MollySophia committed 47 days ago

Verified adef8178

cuda: remove linking to cublasLt (#14790)

yeahdongcn committed 47 days ago

Verified 48b86c4f

opencl: fix `im2col` when `KW!=KH` (#14803)

CISC committed 47 days ago

Verified 38d3af1b

opencl: add conv2d kernel (#14403)

rmatif committed 47 days ago

Verified 6c9ee3b1

sycl: Fix im2col (#14797)

Rbiessy committed 47 days ago

Verified cd465d82

kleidiai: add support for get_rows (#14676)

chaxu01 committed 47 days ago

Verified 92204260

docs : fix backends table in README.md (#14796)

rgerganov committed 48 days ago

Verified 2ba1333b

vulkan/cuda: Fix im2col when KW!=KH (#14789)

jeffbolznv committed 48 days ago

Verified c2e058f1

llama : fix `--reverse-prompt` crashing issue (#14794)

MollySophia committed 48 days ago

Verified c82d48ec

server : add parse_special option to /tokenize endpoint (#14783)

IsaacDynamo committed 48 days ago

Verified b4efd77f

docs : fix link for tools/perplexity in README.md (#14780)

am17an committed 48 days ago

Verified 2be60cbc

Documentation: Further revisions to the Vulkan section in build.md (#14785)

rspOverflow committed 48 days ago

Verified b526ad26

Clang-format: local files first + fix BinPacking (#14779)

am17an committed 49 days ago

Verified 938b7857

Contrib: add 0cc4m as codeowner for Vulkan backend (#14775)

0cc4m committed 49 days ago

Verified 36c15324

ggml: adds CONV_2D op and direct GEMM Vulkan implementation (#14316)

etasnadi committed 49 days ago

Verified a979ca22

imatrix : use GGUF to store importance matrices (#9400)

compilade committed 49 days ago

Verified 90083283

vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info (#13274) (#14707)

Peter0x44 committed 49 days ago

Verified d4b91ea7

Vulkan: Fix fprintf format-security warning (#14770)

0cc4m committed 49 days ago

Verified 83f58724

Newer Older