ggerganov/llama.cpp

Pull Requests Commits

swap worker <--> main thread design

ngxson committed 1 day ago

9871d51f

run common_speculative_process in worker

ngxson committed 1 day ago

51a4f630

vendor: update BoringSSL to 0.20260813.0 (#27099)

cabelo committed 2 days ago

Verified adb55e51

vendor : update cpp-httplib to 0.53.1 (#27103)

cabelo committed 2 days ago

Verified 77140d24

common: support --models-dir loading MTP assistant models (#24431)

EZForever committed 2 days ago

Verified 5f754ea0

fix: check gguf array type before reading (#27075)

ngxson committed 2 days ago

Verified 27df9199

vulkan: add SHMEM_STRIDE_PAD/APPLY_SLM_A_RESHAPE for coopmat1 on Intel Xe (#25380)

fish-jiang committed 2 days ago

Verified 9b0a2ce8

common: migrate the deprecated --mmap/--no-mmap to --load-mode (#26934)

fboudra committed 2 days ago

Verified 0177dcc7

rillomas committed 2 days ago

6b4344ec

Fixed gating logic for problematic Intel driver version

rillomas committed 2 days ago

7b38cb71

mtmd: fix Granite4 Vision image sequence assembly (#26653)

hbattu73 committed 2 days ago

Verified 9d57ce45

model : add support for MiniMaxText01ForCausalLM and MiniMaxM1ForCausalLM (#27018)

fairydreaming committed 2 days ago

Verified 16d222fc

mtmd, common: various fixes (#27071)

ngxson committed 2 days ago

Verified 6fed9f6f

jinja : fix quadratic cost in gather_string_parts (#27034)

Yunzez committed 2 days ago

Verified 9e40df63

chat : pass reasoning_effort to template

sobakasu committed 2 days ago

Verified 7e4c0a96

ggerganov committed 2 days ago

9b05354e

ggml : bump version to 0.20.0 (ggml/1584)

ggerganov committed 2 days ago

06ae2326

ggml : recurrent state rollback for ggml_ssm_scan (#26623)

lnigam committed 2 days ago

Verified 1692f9e5

llama : allow virtual igpu devices (#26953)

ggerganov committed 3 days ago

Verified 4c1a0af4

server: allow accessing /metrics and /slots during llama_decode() (#27041)

ngxson committed 3 days ago

Verified 77918caf

tests : replace personal home directory paths with generic placeholders (#27043)

jimw567 committed 3 days ago

Verified 885c5bbe

sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (#26779)

Titaniumtown committed 3 days ago

Verified 65091386

ggml: force single thread on wasi (#25686)

MendyBerger committed 3 days ago

Verified c6f6a92c

sycl: fuse the gated-delta-net state writeback cpy (#26643)

Titaniumtown committed 3 days ago

Verified 3d938853

dflash : clarify output logging of target_layer_ids (#27013)

danbev committed 3 days ago

Verified 2bacf9ea

common: apply CPU parameters across tools (#27026)

nikwen committed 3 days ago

Verified a94d563e

ui: Refactor data-attrs constants, enum for bool strings (#27002)

ServeurpersoCom committed 3 days ago

Verified bdffafa5

refactor: Naming (#27001)

allozaur committed 3 days ago

Verified fa4ec459

ui: fix VITE_PUBLIC_SERVER variable reading (#24845)

brainrom committed 3 days ago

Verified 9c5531e2

OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (#26952)

wine99 committed 3 days ago

Verified aee56b3a

Older