ggerganov/llama.cpp

Pull Requests Commits

server : improve ctx names

ggerganov committed 9 days ago

Verified 1afee5b2

server : draft prompt cache and checkpoints

ggerganov committed 9 days ago

Verified 11fd5e72

server : sketch the ctx_dft decode loop

ggerganov committed 9 days ago

Verified c97dc360

cont : dedup ctx_seq_rm_type

ggerganov committed 9 days ago

Verified 8a50f6f0

cont : pass seq_id

ggerganov committed 9 days ago

Verified 77269ad8

spec : update common_speculative_init()

ggerganov committed 9 days ago

Verified 4550f0f0

spec : drop support for incompatible vocabs

ggerganov committed 9 days ago

Verified befc7ef6

spec : refactor

ggerganov committed 9 days ago

Verified 2c9a4084

llama : fix device state save/load (#22805)

ggerganov committed 9 days ago

Verified e43431b3

opencl: add opfilter regex for debugging (#22782)

shaofeiqi committed 9 days ago

Verified ceb7e14b

common/chat : preserve media markers for typed-content templates (#22634)

aldehir committed 9 days ago

Verified 093be624

tests: add long-sequence cases and fix inputs for gated_delta_net (#22794)

Neroued committed 9 days ago

Verified deab41ec

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

aicss-genai committed 9 days ago

Verified ad092246

Write a readme on Multi-GPU usage in llama.cpp (#22729)

gaugarg-nv committed 9 days ago

Verified b9afc19c

llama : remove unnecessary seq_id check during state restore (#22797)

ggerganov committed 9 days ago

Verified 803627f1

ggml-cpu: Optimized risc-v cpu q1_0 dot

pl752 committed 9 days ago

Verified 68380ae1

mtmd: fix whisper audio tail truncation by exposing padded buffer to FFT (#22770)

ServeurpersoCom committed 9 days ago

Verified cc97e45a

model: Add Mimo v2.5 model support (#22493)

AesSedai committed 9 days ago

Verified 8e52631d

webui: fix ?model= URL param race in router mode (#22771)

ServeurpersoCom committed 9 days ago

Verified f4b5a2ee

codeowners : add ZenDNN backend codeowner (#22772)

z-vishal committed 10 days ago

Verified 97f06e9e

webui: fix flicker issue on dismiss animation on overlay primitives (#22773)

vignesh191 committed 10 days ago

Verified e358d75a

sycl : fix test script (#22737)

dogunbound committed 10 days ago

Verified cfff1fc3

llama : add missing call to ggml_backend_load_all() (#22752)

angt committed 10 days ago

Verified 3980e04d

mtmd : support MiniCPM-V 4.6 (#22529)

tc-mb committed 10 days ago

Verified 2496f9c1

model : don't crash on unsupported architecture (#22742)

giladgd committed 10 days ago

Verified 5207d120

common: do not fit to unknown device memory (#22614)

fl0rianr committed 10 days ago

Verified a0101225

gguf-py : bump version to 0.19.0 (#22664)

ggerganov committed 10 days ago

Verified a290ce62

mtmd: add granite-speech support (ibm-granite/granite-4.0-1b-speech) (#22101)

ReinforcedKnowledge committed 10 days ago

Verified a00e47e4

feat: migrate to PEP 621 and add uv support (#21907)

dhdaines committed 10 days ago

Verified 75014196

convert : ignore non-language tensors for Gemma4Model (#22753)

danbev committed 10 days ago

Verified a736e6c0

Newer Older