ggml-org/llama.cpp

Pull Requests Commits

quant : allow quantization of ffn_gate_inp tensors

ggerganov committed 99 days ago

Verified 58137f0f

ci: fix pre-built binaries no longer working on macOS 15 and below (#26375)

nikwen committed 99 days ago

Verified 6b5224cf

speculative : refactor enabled configs common_speculative_init (#26510)

danbev committed 99 days ago

Verified 7bd8282c

gguf-py: validate n_dims and guard against uint64 overflow in reader (#25401)

hclsys committed 99 days ago

Verified 5788b510

ggerganov committed 99 days ago

2e17f69e

ggml : bump version to 0.18.1 (ggml/1578)

ggerganov committed 99 days ago

15831f57

convert : add missing return after setting tekken vocab (#25947)

AngelGalindo7 committed 99 days ago

Verified b5746d28

vulkan backend ops: implemented GATED_LINEAR_ATTN (#25601)

PranavUttarkar committed 99 days ago

Verified f26efa02

vocab : validate plamo2 byte tokens (#26511)

CISC committed 99 days ago

Verified cf06ad7d

convert : import bytes_to_unicode from convert_slow_tokenizer (#26217)

SolshineCode committed 99 days ago

Verified b06fbc96

model : allow reshape of tensors during load (#26531)

ggerganov committed 100 days ago

Verified 1269cb1f

llama : move n_vocab from llama_sampler_data to penalty_sampler (#26520)

ggerganov committed 100 days ago

Verified 935cad64

ci: fix vulkan llvmpipe runs (#26533)

netrunnereve committed 100 days ago

Verified 22dc605c

sycl: parallelize the non-contiguous concat kernel (#25852)

Titaniumtown committed 100 days ago

Verified 6c8dcaa7

Extended SYCL oneDNN SDPA to non-FP16 KV caches (Q4_0–Q8_0 and FP32) (#25874)

johnkarlhill committed 100 days ago

Verified 66fa168a

chat : add new template for DeepSeek V4 Flash 0731 (#26398)

tarruda committed 100 days ago

Verified 0ef6e55e

vendor : update cpp-httplib to 0.52.0 (#26485)

cabelo committed 100 days ago

Verified 94bc47f2

vendor : update BoringSSL to 0.20260803.0 (#26523)

cabelo committed 100 days ago

Verified fe2adf0e

model : support MTP in GLM-4.7-Flash (#24868)

jacekpoplawski committed 100 days ago

Verified 57c09213

tests: add model resolution test on synthetic repo listings (#26172)

ServeurpersoCom committed 100 days ago

Verified ee0445c9

server: add get_info tool (#26522)

ngxson committed 100 days ago

Verified 99111b19

vocab : validate default special token ids (#26506)

CISC committed 100 days ago

Verified e8e06f78

ggml: use dynamic allocation for split graph inputs (#22789)

AgoraPete committed 100 days ago

Verified dbadb68e

opencl: route large q6_K lm_head to the flat GEMV (#26427)

wanghqc committed 100 days ago

Verified 39eab74a

graph : fix unused input tensors in minimax m3 graph (#26519)

ggerganov committed 100 days ago

Verified c50b34a1

model: M3: Move MSA into a new memory implementation (#26338)

timkhronos committed 100 days ago

Verified 67d5978b

llama : allocate indexer cache only in "full" indexer layers (#26474)

fairydreaming committed 100 days ago

Verified 563dec81

CUDA: Add backend sampler for penalties sampler (#25262)

kmorennv committed 100 days ago

Verified 96278e39

CUDA: Fix data-races when reusing SMEM in block_reduce (#26385)

ORippler committed 100 days ago

Verified 9bd4c09e

server: add notice for upcoming default port change 8080 --> 9931 (#26508)

ngxson committed 100 days ago

Verified 0b14b87d

Older