ggerganov/llama.cpp

Pull Requests Commits

ggml: update SCHED_DEBUG output to use ggml_op_desc()

max-krasnyansky committed 9 days ago

ba72d4d2

model: Support sarashina2.2-vision-3b model (#22103)

samuraieng committed 9 days ago

Verified 44dbe8c5

CUDA: batch out_prod inner loop with cublasSgemmStridedBatched (#22651)

leonardHONG committed 9 days ago

Verified 05ff59cb

webui: add option for LLM title generation (#22265)

smugman-dot committed 10 days ago

Verified aaf4a4d5

llama : fix device state save/load (#22805)

ggerganov committed 10 days ago

Verified e43431b3

opencl: add opfilter regex for debugging (#22782)

shaofeiqi committed 10 days ago

Verified ceb7e14b

common/chat : preserve media markers for typed-content templates (#22634)

aldehir committed 10 days ago

Verified 093be624

tests: add long-sequence cases and fix inputs for gated_delta_net (#22794)

Neroued committed 10 days ago

Verified deab41ec

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

aicss-genai committed 10 days ago

Verified ad092246

Write a readme on Multi-GPU usage in llama.cpp (#22729)

gaugarg-nv committed 10 days ago

Verified b9afc19c

llama : remove unnecessary seq_id check during state restore (#22797)

ggerganov committed 10 days ago

Verified 803627f1

ggml-cpu: Optimized risc-v cpu q1_0 dot

pl752 committed 10 days ago

Verified 68380ae1

mtmd: fix whisper audio tail truncation by exposing padded buffer to FFT (#22770)

ServeurpersoCom committed 10 days ago

Verified cc97e45a

model: Add Mimo v2.5 model support (#22493)

AesSedai committed 10 days ago

Verified 8e52631d

webui: fix ?model= URL param race in router mode (#22771)

ServeurpersoCom committed 10 days ago

Verified f4b5a2ee

codeowners : add ZenDNN backend codeowner (#22772)

z-vishal committed 10 days ago

Verified 97f06e9e

webui: fix flicker issue on dismiss animation on overlay primitives (#22773)

vignesh191 committed 10 days ago

Verified e358d75a

sycl : fix test script (#22737)

dogunbound committed 10 days ago

Verified cfff1fc3

llama : add missing call to ggml_backend_load_all() (#22752)

angt committed 10 days ago

Verified 3980e04d

mtmd : support MiniCPM-V 4.6 (#22529)

tc-mb committed 11 days ago

Verified 2496f9c1

model : don't crash on unsupported architecture (#22742)

giladgd committed 11 days ago

Verified 5207d120

common: do not fit to unknown device memory (#22614)

fl0rianr committed 11 days ago

Verified a0101225

gguf-py : bump version to 0.19.0 (#22664)

ggerganov committed 11 days ago

Verified a290ce62

mtmd: add granite-speech support (ibm-granite/granite-4.0-1b-speech) (#22101)

ReinforcedKnowledge committed 11 days ago

Verified a00e47e4

feat: migrate to PEP 621 and add uv support (#21907)

dhdaines committed 11 days ago

Verified 75014196

convert : ignore non-language tensors for Gemma4Model (#22753)

danbev committed 11 days ago

Verified a736e6c0

webui: Remove Google Favicons & Improve MCP Information logic & UI (#22719)

allozaur committed 11 days ago

Verified e3e3f8e4

ggml-cpu: fuse RMS_NORM + MUL on CPU backend (#22423)

zzzzwc committed 11 days ago

Verified f08f20a0

add tabindex and aria-hidden (#22699)

vignesh191 committed 11 days ago

Verified 07eaf919

convert : add filter_tensors method to pre-filter tensors (#22597)

CISC committed 11 days ago

Verified 74d6248f

Older