ggerganov/llama.cpp

Pull Requests Commits

vulkan: Handle updated FA dim2/3 definition (#14518)

jeffbolznv committed 162 days ago

Verified a0374a67

server : fix assistant prefilling when content is an array (#14360)

CISC committed 162 days ago

Verified ddef9952

opencl: add GELU_ERF (#14476)

CISC committed 162 days ago

Verified 66816881

eval-callback : check for empty input (#14539)

ggerganov committed 162 days ago

Verified bac8bed2

test-backend-ops: add support for specifying output format (#14368)

yeahdongcn committed 162 days ago

Verified b81510a7

metal : disable fast math in all quantize kernels (#14528)

ggerganov committed 162 days ago

Verified ef797db3

batch : add optional for sequential equal split (#14511)

ggerganov committed 163 days ago

Verified 67d1ef23

graph : prepare for 4D mask (#14515)

ggerganov committed 163 days ago

Verified 7b50f7c0

batch : add n_used count (#14512)

ggerganov committed 163 days ago

Verified c79184d2

CANN: Replace aclrtMemsetSync with aclnnInplaceZero operator (#14002)

luyhcsu committed 163 days ago

Verified 499a8f5a

model : add Jamba to Mamba-specific hparams printing

compilade committed 163 days ago

07c252f0

graph : add back hybrid memory graph input

compilade committed 163 days ago

20f8e43e

ggml : implement GEGLU_ERF and GEGLU_QUICK ops (#14445)

CISC committed 163 days ago

Verified 28657a82

Merge branch 'master' into compilade/refactor-kv-cache

compilade committed 163 days ago

4682e21c

opencl : broadcast for soft_max (#14510)

lhez committed 163 days ago

Verified bee28421

vulkan: support mixed/deepseekR1 FA head sizes (#14509)

jeffbolznv committed 163 days ago

Verified 2b72bede

ggml: backward pass for split swiglu (#14483)

JohannesGaessler committed 163 days ago

Verified c8c4495b

Fix conditional enabling following arch checks for ggml-sycl (#14504)

s-Nick committed 163 days ago

Verified 7b63a71a

convert : correct gemma 3n conversion (#14450)

ngxson committed 164 days ago

Verified 0c2ee38a

kv-cache : use ggml_set_rows (#14285)

ggerganov committed 164 days ago

Verified a70c8a0c

ggml : fix FA mask dim 2 and 3 (#14505)

ggerganov committed 164 days ago

Verified 9067487c

ggml : remove kompute backend (#14501)

ggerganov committed 164 days ago

Verified d4cdd9c1

convert : fix jamba conv1d shape squeezing

compilade committed 164 days ago

908e6559

Merge branch 'master' into compilade/refactor-kv-cache

compilade committed 164 days ago

2bcaf64e

CUDA: add dynamic shared mem to softmax, refactor general usage (#14497)

am17an committed 164 days ago

Verified 55c2646b

gguf-py : add support for chat template jinja files (#14508)

CISC committed 164 days ago

Verified e75ba4c0

llama : initial Mamba-2 support (#9126)

compilade committed 164 days ago

Verified 5d46babd

ggerganov committed 164 days ago

e17991c4

ggml : add version function to get lib version (ggml/1286)

danbev committed 164 days ago

c46944aa

Set RPATH to "@loader_path" / "$ORIGIN" to ensure executables and dynamic libraries search for dependencies in their origin directory. (#14309)

rotemdan committed 164 days ago

Verified f3ed38d7

Newer Older