ggml-org/llama.cpp

Pull Requests Commits
releases : use dl backend for linux release, remove arm64 linux release (#13996)
slaren committed 1 year ago
Verified 48254871
llama-graph : use ggml_repeat_4d (#13998)
ngxson committed 1 year ago
Verified 3ac67535
CUDA: fix FTZ in FA for Gemma 3 (#13991)
JohannesGaessler committed 1 year ago
Verified 0b4be4c4
kv-cache : fix unified::seq_rm to work with seq_id < 0 (#13985)
ggerganov committed 1 year ago
Verified e0e806f5
vulkan: fix warnings in perf logger querypool code (#13937)
jeffbolznv committed 1 year ago
Verified 7e00e60e
docs : add "Quick start" section for new users (#13862)
ngxson committed 1 year ago
Verified ea1431b0
opencl: add `backend_synchronize` (#13939)
lhez committed 1 year ago
Verified 71e74a3a
OpenCL: Add concat, tsembd, upscale, tanh, pad and repeat (#13840)
rmatif committed 1 year ago
Verified bfb1e012
server : disable speculative decoding for SWA models (#13970)
ggerganov committed 1 year ago
Verified 36375762
metal : use F32 accumulators in FA kernels (#13975)
ggerganov committed 1 year ago
Verified ea394d7a
gemma : more consistent attention scaling for v2 and v3 (#13951)
ggerganov committed 1 year ago
Verified 5582c49c
`server`: update deepseek reasoning format (pass reasoning_content as diffs) (#13933)
ochafik committed 1 year ago
Verified c9bbc779
mtmd : fix memory leak in mtmd_helper_eval_chunk_single (#13961)
ngxson committed 1 year ago
Verified bfd32279
cmake : Handle mixed-case 'Power' strings in POWER CPU detection (#13966)
shalinib-ibm committed 1 year ago
Verified 093e3f1f
sycl: quantize and reorder the input to q8_1 when reorder is enabled (#13826)
AD2605 committed 1 year ago
Verified 663445b0
gguf: fix failure on version == 0 (#13956)
JohannesGaessler committed 1 year ago
Verified 7675c555
convert : fix nomic-bert-moe mask token (#13757)
CISC committed 1 year ago
Verified 5e1c3aed
convert : fix vocab padding code for bert models (#13954)
CISC committed 1 year ago
Verified c496fe0b
ggml: check if non-native endian model is being loaded (#13943)
taronaeo committed 1 year ago
Verified e57bb87c
sync : ggml
ggerganov committed 1 year ago
f3a4b165
vulkan : Remove unexpected ; (ggml/1253)
dg0yt committed 1 year ago
108009f5
cmake : Fix broken CMake error messages (ggml/1252)
dg0yt committed 1 year ago
d337252a
ggml : remove ggml_graph_import and ggml_graph_export declarations (ggml/1247)
rgerganov committed 1 year ago
af6f91db
sync : whisper.cpp (ggml/1250)
ggerganov committed 1 year ago
a7b8d35f
ggml : install dynamic backends (ggml/1240)
rgerganov committed 1 year ago
6eba72b7
ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)
danielzgtg committed 1 year ago
fedf034a
readme : update bindings (#13950)
ddh0 committed 1 year ago
Verified 8726392d
parallel : fix n_junk == 0 (#13952)
ggerganov committed 1 year ago
Verified c0462171
kv-cache : split implementation in separate sources (#13920)
ggerganov committed 1 year ago
Verified 0fc16b42
threading: support for GGML_SCHED_PRIO_LOW, update thread info on Windows to avoid throttling (#12995)
max-krasnyansky committed 1 year ago
Verified 053b1539
Terms Of Use Privacy Policy Refund Policy Impressum