ggml-org/llama.cpp

Pull Requests Commits

cont : fix `cur_buf_size` init after flushing a buffer

ggerganov committed 2 days ago

Verified 3f9bcab8

ggml : add `alloc_buffer_n` to buffer type interface

ggerganov committed 3 days ago

Verified 0743dce6

ui: fix stop/continue during an agentic loop (#23356)

ServeurpersoCom committed 3 days ago

Verified 5a4126ad

convert : add compressed-tensors NVFP4 support (#21095)

michaelw9999 committed 3 days ago

Verified a4d2d4ae

ggerganov committed 3 days ago

d161ea70

ggml : bump version to 0.13.0 (ggml/1510)

ggerganov committed 3 days ago

45158f46

ggerganov committed 3 days ago

22307b3e

ggml : bump version to 0.12.1 (ggml/1508)

ggerganov committed 3 days ago

ce5890b5

ggml.h: correct ggml_silu_back arg docstring (a=dy, b=x) (ggml/1500)

OriPekelman committed 3 days ago

b251f74f

ggml-alloc: fix out-of-bounds read in ggml_dyn_tallocr_remove_block (ggml/1492)

Dev-X25874 committed 3 days ago

fa970415

TP: fix ggml context size calculation (#22616)

JohannesGaessler committed 3 days ago

Verified ae251b5f

ggml: `gguf_init_from_callback` and `gguf_init_from_buffer` (#22341)

giladgd committed 3 days ago

Verified 66efd133

server: MTP layer kv-cache should respect draft type ctk (#23646)

am17an committed 3 days ago

Verified 6c4cbdc7

ci : update spacemit toolchain url and enhance curl command (#23642)

alex-spacemit committed 3 days ago

Verified 5fdf07e3

ci : fix pre-tokenizer-hashes check (#23651)

CISC committed 3 days ago

Verified 062d3115

llama : document that only one on-device state can be saved per sequence (#23520)

TimNN committed 3 days ago

Verified 314e7293

ci : install host compiler on android-ndk build (#23630)

aldehir committed 3 days ago

Verified d55fb971

ggml : Parallelize quant LUT init (#23595)

jeffbolznv committed 3 days ago

Verified 826539ce

ui: media attachments before text (#23467)

sfallah committed 3 days ago

Verified b9648764

vendor : update cpp-httplib to 0.45.1 (#23639)

cabelo committed 3 days ago

Verified 9627d0f5

server: fix checkpoints creation (#22929)

jacekpoplawski committed 3 days ago

Verified e2ef8fe4

perplexity : fix even more integer overflows (#23623)

fairydreaming committed 3 days ago

Verified 6d57c26e

ci : move most slim jobs to self-hosted runners (#23619)

ggerganov committed 3 days ago

Verified 28123a39

ci : update build-self-hosted.yml (#23616)

ggerganov committed 3 days ago

Verified 549b9d84

convert : minor fixes for numpy 2.x (#23571)

CISC committed 4 days ago

Verified 5d246a79

cmake : fix ui build (#23592)

aldehir committed 4 days ago

Verified 63248fc3

server: add margin for draft model for `fit` (#23485)

am17an committed 4 days ago

Verified 83eebe9d

TP: fix entirely zero-sized slices per device (#23525)

JohannesGaessler committed 4 days ago

Verified fff63b51

opencl: batch profiling to improve speed and prevent memory leaks (#23495)

shaofeiqi committed 4 days ago

Verified f3061116

hexagon: apply repl optimization in flash attn softmax as #22993 (#23455)

njsyw1997 committed 4 days ago

Verified 1c0f6db5

Older