ggerganov/llama.cpp

Pull Requests Commits
ggml : remove kompute backend (#14501)
ggerganov committed 128 days ago
Verified d4cdd9c1
CUDA: add dynamic shared mem to softmax, refactor general usage (#14497)
am17an committed 128 days ago
Verified 55c2646b
gguf-py : add support for chat template jinja files (#14508)
CISC committed 128 days ago
Verified e75ba4c0
llama : initial Mamba-2 support (#9126)
compilade committed 128 days ago
Verified 5d46babd
sync : ggml
ggerganov committed 128 days ago
e17991c4
ggml : add version function to get lib version (ggml/1286)
danbev committed 128 days ago
c46944aa
Set RPATH to "@loader_path" / "$ORIGIN" to ensure executables and dynamic libraries search for dependencies in their origin directory. (#14309)
rotemdan committed 128 days ago
Verified f3ed38d7
CUDA: add softmax broadcast (#14475)
am17an committed 129 days ago
55a1c5a5
CUDA: broadcasting for FlashAttention mask (#14500)
JohannesGaessler committed 129 days ago
12a81af4
vulkan: support softmax/FA batch and broadcast (#14449)
jeffbolznv committed 129 days ago
8875523e
ggml : support bcast ggml_soft_max_ext, ggml_flash_attn_ext (#14435)
ggerganov committed 129 days ago
ec68e84c
opencl : fix possible buffer overflow in dump_tensor (#14490)
jeffzhou2000 committed 129 days ago
Verified 307e79d3
simple-chat : fix context-exceeded condition (#14494)
ggerganov committed 129 days ago
Verified d7f5f4e5
opencl : skip empty nodes on cgraph compute (#14491)
EZForever committed 129 days ago
Verified c8a4e470
opencl : update upscale to support align corners (#14488)
lhez committed 129 days ago
Verified 603e43dc
ci : add OpenCL to labeler workflow (#14496)
CISC committed 129 days ago
Verified 611ba4b2
github : add OpenCL backend to issue templates (#14492)
EZForever committed 129 days ago
Verified 85841e12
ggml : Callback before abort (#14481)
ScaledLizard committed 129 days ago
Verified 68b3cd65
ci : disable fast-math for Metal GHA CI (#14478)
ggerganov committed 130 days ago
Verified de569441
Add Vulkan images to docker.md (#14472)
xek committed 130 days ago
Verified 1b2aaf28
CANN: update aclnnGroupedMatmulV2 to aclnnGroupedMatmulV3 (#14411)
noemotiovon committed 130 days ago
Verified 343b6e94
vulkan: Split large mul_mat_id to fit in shared memory (#14451)
jeffbolznv committed 130 days ago
Verified 6a746cf9
add GELU_ERF (#14455)
CISC committed 130 days ago
Verified eff5e454
ggml : remove trailing whitespace (#0)
ggerganov committed 130 days ago
a6a47958
sync : ggml
ggerganov committed 130 days ago
f61c05d4
ggml-cpu : "align corners" for bilinear upscale/downscale (ggml/1285)
Acly committed 130 days ago
431b2c24
ggml-quants : rename best_mad to best_error (ggml/1283)
danbev committed 130 days ago
497be7c0
opencl : add GEGLU, REGLU, SWIGLU (#14456)
lhez committed 130 days ago
Verified 79b33b23
Add Conv2d for CPU (#14388)
am17an committed 130 days ago
Verified 0a5a3b5c
memory : correctly handle failure in apply() (#14438)
ggerganov committed 131 days ago
Verified 745f11fe
Terms Of Use Privacy Policy Refund Policy Impressum