ggerganov/llama.cpp

Pull Requests Commits

vulkan : fix rope with partial rotation and non-cont src (#14582)

jeffbolznv committed 157 days ago

Verified b8eeb874

server: Add ability to mount server at prefix (#14544)

oluwandabira committed 157 days ago

Verified 17a1f0d2

model : add hunyuan moe (#14425)

ngxson committed 157 days ago

Verified 8f22dc0a

vulkan: increase timeout for CI (#14574)

jeffbolznv committed 157 days ago

Verified 53903ae6

cuda : fix rope with partial rotation and non-cont src (#14580)

ggerganov committed 157 days ago

Verified 4d0dcd4a

CUDA: add bilinear interpolation for upscale (#14563)

am17an committed 157 days ago

Verified 75c91de6

musa: fix build warnings (unused variable) (#14561)

yeahdongcn committed 157 days ago

Verified 68155c66

llama : fix incorrect minicpm3 v_states shape (#14571)

CISC committed 157 days ago

Verified e1a70590

llama : remove ggml_cont where possible (#14568)

CISC committed 157 days ago

Verified 12f55c30

CUDA: add bf16 and i32 to getrows (#14529)

am17an committed 158 days ago

Verified b9c3eefd

vulkan: increase LOAD_VEC_A to 8 (IQ1/IQ2) or 4 (IQ3) (#14485)

netrunnereve committed 159 days ago

Verified 6491d6e4

vulkan: fix rms_norm+mul fusion (#14545)

jeffbolznv committed 159 days ago

Verified e592be15

vulkan: Handle updated FA dim2/3 definition (#14518)

jeffbolznv committed 160 days ago

Verified a0374a67

server : fix assistant prefilling when content is an array (#14360)

CISC committed 160 days ago

Verified ddef9952

opencl: add GELU_ERF (#14476)

CISC committed 160 days ago

Verified 66816881

eval-callback : check for empty input (#14539)

ggerganov committed 160 days ago

Verified bac8bed2

test-backend-ops: add support for specifying output format (#14368)

yeahdongcn committed 160 days ago

Verified b81510a7

metal : disable fast math in all quantize kernels (#14528)

ggerganov committed 160 days ago

Verified ef797db3

batch : add optional for sequential equal split (#14511)

ggerganov committed 161 days ago

Verified 67d1ef23

graph : prepare for 4D mask (#14515)

ggerganov committed 161 days ago

Verified 7b50f7c0

batch : add n_used count (#14512)

ggerganov committed 161 days ago

Verified c79184d2

CANN: Replace aclrtMemsetSync with aclnnInplaceZero operator (#14002)

luyhcsu committed 161 days ago

Verified 499a8f5a

ggml : implement GEGLU_ERF and GEGLU_QUICK ops (#14445)

CISC committed 161 days ago

Verified 28657a82

opencl : broadcast for soft_max (#14510)

lhez committed 161 days ago

Verified bee28421

vulkan: support mixed/deepseekR1 FA head sizes (#14509)

jeffbolznv committed 161 days ago

Verified 2b72bede

ggml: backward pass for split swiglu (#14483)

JohannesGaessler committed 161 days ago

Verified c8c4495b

Fix conditional enabling following arch checks for ggml-sycl (#14504)

s-Nick committed 162 days ago

Verified 7b63a71a

convert : correct gemma 3n conversion (#14450)

ngxson committed 162 days ago

Verified 0c2ee38a

kv-cache : use ggml_set_rows (#14285)

ggerganov committed 162 days ago

Verified a70c8a0c

ggml : fix FA mask dim 2 and 3 (#14505)

ggerganov committed 162 days ago

Verified 9067487c

Newer Older