ggerganov/llama.cpp

Pull Requests Commits

releases : use dl backend for linux release, remove arm64 linux release (#13996)

slaren committed 98 days ago

Verified 48254871

llama-graph : use ggml_repeat_4d (#13998)

ngxson committed 98 days ago

Verified 3ac67535

CUDA: fix FTZ in FA for Gemma 3 (#13991)

JohannesGaessler committed 98 days ago

Verified 0b4be4c4

kv-cache : fix unified::seq_rm to work with seq_id < 0 (#13985)

ggerganov committed 98 days ago

Verified e0e806f5

vulkan: fix warnings in perf logger querypool code (#13937)

jeffbolznv committed 98 days ago

Verified 7e00e60e

docs : add "Quick start" section for new users (#13862)

ngxson committed 99 days ago

Verified ea1431b0

opencl: add `backend_synchronize` (#13939)

lhez committed 99 days ago

Verified 71e74a3a

OpenCL: Add concat, tsembd, upscale, tanh, pad and repeat (#13840)

rmatif committed 99 days ago

Verified bfb1e012

server : disable speculative decoding for SWA models (#13970)

ggerganov committed 99 days ago

Verified 36375762

metal : use F32 accumulators in FA kernels (#13975)

ggerganov committed 99 days ago

Verified ea394d7a

gemma : more consistent attention scaling for v2 and v3 (#13951)

ggerganov committed 99 days ago

Verified 5582c49c

`server`: update deepseek reasoning format (pass reasoning_content as diffs) (#13933)

ochafik committed 99 days ago

Verified c9bbc779

mtmd : fix memory leak in mtmd_helper_eval_chunk_single (#13961)

ngxson committed 100 days ago

Verified bfd32279

cmake : Handle mixed-case 'Power' strings in POWER CPU detection (#13966)

shalinib-ibm committed 100 days ago

Verified 093e3f1f

sycl: quantize and reorder the input to q8_1 when reorder is enabled (#13826)

AD2605 committed 100 days ago

Verified 663445b0

gguf: fix failure on version == 0 (#13956)

JohannesGaessler committed 101 days ago

Verified 7675c555

convert : fix nomic-bert-moe mask token (#13757)

CISC committed 101 days ago

Verified 5e1c3aed

convert : fix vocab padding code for bert models (#13954)

CISC committed 101 days ago

Verified c496fe0b

ggml: check if non-native endian model is being loaded (#13943)

taronaeo committed 101 days ago

Verified e57bb87c

ggerganov committed 101 days ago

f3a4b165

vulkan : Remove unexpected ; (ggml/1253)

dg0yt committed 101 days ago

108009f5

cmake : Fix broken CMake error messages (ggml/1252)

dg0yt committed 101 days ago

d337252a

ggml : remove ggml_graph_import and ggml_graph_export declarations (ggml/1247)

rgerganov committed 101 days ago

af6f91db

sync : whisper.cpp (ggml/1250)

ggerganov committed 101 days ago

a7b8d35f

ggml : install dynamic backends (ggml/1240)

rgerganov committed 101 days ago

6eba72b7

ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)

danielzgtg committed 101 days ago

fedf034a

readme : update bindings (#13950)

ddh0 committed 101 days ago

Verified 8726392d

parallel : fix n_junk == 0 (#13952)

ggerganov committed 101 days ago

Verified c0462171

kv-cache : split implementation in separate sources (#13920)

ggerganov committed 101 days ago

Verified 0fc16b42

threading: support for GGML_SCHED_PRIO_LOW, update thread info on Windows to avoid throttling (#12995)

max-krasnyansky committed 101 days ago

Verified 053b1539

Newer Older