ggerganov/llama.cpp

Pull Requests Commits

am17an committed 7 days ago

db5abb47

rpc : allow `-sm tensor` on RDMA enabled devices

am17an committed 7 days ago

15a0c9f6

set coarser granularity for head splits

am17an committed 7 days ago

80b2f518

DSV4: sm tensor

am17an committed 7 days ago

38b3cdc4

Prefer npm ci over install for security (#26601)

eapache committed 8 days ago

Verified 6ea215d1

server: decode Windows OEM output to UTF-8 in built-in tools (#26597)

ServeurpersoCom committed 8 days ago

Verified 4308a4f0

mtmd: correcting duplicate empty audio chunks for short inputs (#26536)

Abhinaykrishna2 committed 8 days ago

Verified 474c92e7

sampler : remove "full-context windows" from history-based samplers (#26524)

ggerganov committed 8 days ago

Verified a6aa6f54

gguf-split: Add option to delete split parts during merge (#26538)

guiq83 committed 8 days ago

Verified 76c956c1

ui: CWD for agent (#26518)

allozaur committed 8 days ago

Verified 2f56fc34

mtmd: support Qwen3-TTS (note: breaking change to llama-tts binary) (#26254)

ngxson committed 8 days ago

Verified 07132750

models : fix dflash wo_a reshape on load (#26577)

ggerganov committed 8 days ago

Verified 1c3c9674

ci: fix pre-built binaries no longer working on macOS 15 and below (#26375)

nikwen committed 8 days ago

Verified 6b5224cf

speculative : refactor enabled configs common_speculative_init (#26510)

danbev committed 8 days ago

Verified 7bd8282c

gguf-py: validate n_dims and guard against uint64 overflow in reader (#25401)

hclsys committed 8 days ago

Verified 5788b510

ggerganov committed 8 days ago

2e17f69e

ggml : bump version to 0.18.1 (ggml/1578)

ggerganov committed 8 days ago

15831f57

convert : add missing return after setting tekken vocab (#25947)

AngelGalindo7 committed 8 days ago

Verified b5746d28

vulkan backend ops: implemented GATED_LINEAR_ATTN (#25601)

PranavUttarkar committed 8 days ago

Verified f26efa02

vocab : validate plamo2 byte tokens (#26511)

CISC committed 8 days ago

Verified cf06ad7d

convert : import bytes_to_unicode from convert_slow_tokenizer (#26217)

SolshineCode committed 8 days ago

Verified b06fbc96

model : allow reshape of tensors during load (#26531)

ggerganov committed 8 days ago

Verified 1269cb1f

llama : move n_vocab from llama_sampler_data to penalty_sampler (#26520)

ggerganov committed 8 days ago

Verified 935cad64

ci: fix vulkan llvmpipe runs (#26533)

netrunnereve committed 8 days ago

Verified 22dc605c

sycl: parallelize the non-contiguous concat kernel (#25852)

Titaniumtown committed 8 days ago

Verified 6c8dcaa7

Extended SYCL oneDNN SDPA to non-FP16 KV caches (Q4_0–Q8_0 and FP32) (#25874)

johnkarlhill committed 8 days ago

Verified 66fa168a

chat : add new template for DeepSeek V4 Flash 0731 (#26398)

tarruda committed 9 days ago

Verified 0ef6e55e

vendor : update cpp-httplib to 0.52.0 (#26485)

cabelo committed 9 days ago

Verified 94bc47f2

vendor : update BoringSSL to 0.20260803.0 (#26523)

cabelo committed 9 days ago

Verified fe2adf0e

model : support MTP in GLM-4.7-Flash (#24868)

jacekpoplawski committed 9 days ago

Verified 57c09213

Older