ochafik/llama.cpp

Pull Requests Commits

ggml: update SCHED_DEBUG output to use ggml_op_desc() (#22825)

max-krasnyansky committed 53 days ago

Verified 3e941b81

opencl: add q4_0 MoE GEMM for Adreno (#22731)

shawngu-quic committed 53 days ago

Verified f3e8d149

convert : fix RuntimeError when stripping FP8 KV-cache scales (#22818)

pich committed 53 days ago

Verified 1d72d873

fix script error (#22795sycl : )

arthw committed 53 days ago

Verified 6a2a2513

model: Support sarashina2.2-vision-3b model (#22103)

samuraieng committed 53 days ago

Verified 44dbe8c5

CUDA: batch out_prod inner loop with cublasSgemmStridedBatched (#22651)

leonardHONG committed 53 days ago

Verified 05ff59cb

webui: add option for LLM title generation (#22265)

smugman-dot committed 53 days ago

Verified aaf4a4d5

llama : fix device state save/load (#22805)

ggerganov committed 53 days ago

Verified e43431b3

opencl: add opfilter regex for debugging (#22782)

shaofeiqi committed 53 days ago

Verified ceb7e14b

common/chat : preserve media markers for typed-content templates (#22634)

aldehir committed 53 days ago

Verified 093be624

tests: add long-sequence cases and fix inputs for gated_delta_net (#22794)

Neroued committed 53 days ago

Verified deab41ec

sycl: add FILL, CUMSUM, DIAG, SOLVE_TRI, SSM_SCAN, GATED_DELTA_NET (#22149)

aicss-genai committed 53 days ago

Verified ad092246

Write a readme on Multi-GPU usage in llama.cpp (#22729)

gaugarg-nv committed 53 days ago

Verified b9afc19c

llama : remove unnecessary seq_id check during state restore (#22797)

ggerganov committed 53 days ago

Verified 803627f1

ggml-cpu: Optimized risc-v cpu q1_0 dot

pl752 committed 53 days ago

Verified 68380ae1

mtmd: fix whisper audio tail truncation by exposing padded buffer to FFT (#22770)

ServeurpersoCom committed 53 days ago

Verified cc97e45a

model: Add Mimo v2.5 model support (#22493)

AesSedai committed 53 days ago

Verified 8e52631d

webui: fix ?model= URL param race in router mode (#22771)

ServeurpersoCom committed 53 days ago

Verified f4b5a2ee

codeowners : add ZenDNN backend codeowner (#22772)

z-vishal committed 54 days ago

Verified 97f06e9e

webui: fix flicker issue on dismiss animation on overlay primitives (#22773)

vignesh191 committed 54 days ago

Verified e358d75a

sycl : fix test script (#22737)

dogunbound committed 54 days ago

Verified cfff1fc3

llama : add missing call to ggml_backend_load_all() (#22752)

angt committed 54 days ago

Verified 3980e04d

mtmd : support MiniCPM-V 4.6 (#22529)

tc-mb committed 54 days ago

Verified 2496f9c1

model : don't crash on unsupported architecture (#22742)

giladgd committed 54 days ago

Verified 5207d120

common: do not fit to unknown device memory (#22614)

fl0rianr committed 54 days ago

Verified a0101225

gguf-py : bump version to 0.19.0 (#22664)

ggerganov committed 54 days ago

Verified a290ce62

mtmd: add granite-speech support (ibm-granite/granite-4.0-1b-speech) (#22101)

ReinforcedKnowledge committed 54 days ago

Verified a00e47e4

feat: migrate to PEP 621 and add uv support (#21907)

dhdaines committed 54 days ago

Verified 75014196

convert : ignore non-language tensors for Gemma4Model (#22753)

danbev committed 54 days ago

Verified a736e6c0

webui: Remove Google Favicons & Improve MCP Information logic & UI (#22719)

allozaur committed 55 days ago

Verified e3e3f8e4

Newer Older