ggerganov/llama.cpp

Pull Requests Commits

metal : cap threadgroups size of set_rows

ggerganov committed 30 days ago

Verified e6dbc815

metal : enable tensor API for A19 (#17087)

ggerganov committed 30 days ago

Verified c27efd2b

arm64: add i8mm route with SVE ggml_vec_dot_q4_K_q8_K and ggml_vec_dot_q6_K_… (#15277)

fj-y-saito committed 30 days ago

Verified df70bedd

batched-bench : add "separate text gen" mode (#17103)

ggerganov committed 30 days ago

Verified f914544b

mtmd: fix patch_size initialized to random value in audio models (#17128)

ngxson committed 30 days ago

Verified 4b13a684

editorconfig : ignore benches/ (#17140)

ggerganov committed 30 days ago

Verified 9898b57c

cuda/vulkan : bicubic interpolation (#17022)

Acly committed 30 days ago

Verified 1032256e

benches : add eval results (#17139)

ggerganov committed 30 days ago

Verified 15274c0c

mtmd : fix embedding size for image input (#17123)

ggerganov committed 31 days ago

Verified b8595b16

vulkan: fix memory allocations (#17122)

0cc4m committed 31 days ago

Verified 392e09a6

convert : parse safetensors directly (#15667)

compilade committed 31 days ago

Verified 802cef44

convert : handle compressed-tensors quant method (#17069)

compilade committed 31 days ago

Verified 1c07c0c6

server : handle failures to restore host cache (#17078)

ggerganov committed 31 days ago

Verified cb1adf88

benches : add folder with benchmarks (#16931)

ggerganov committed 31 days ago

Verified ef1d8269

Switch to using Ubuntu 25.10 vulkan/mesa (#16497)

ericcurtin committed 31 days ago

Verified 86fde91e

vulkan: iGPU memory reporting fix (#17110)

0cc4m committed 31 days ago

Verified 7f3e9d33

vulkan: fix mmq out of bounds reads (#17108)

0cc4m committed 31 days ago

Verified 8a3519b7

vulkan: fuse mul_mat_id + mul (#17095)

jeffbolznv committed 31 days ago

Verified 80a6cf63

metal : retain src and dst buffers during async ops (#17101)

ggerganov committed 31 days ago

Verified 0750a599

arg: add --cache-list argument to list cached models (#17073)

ngxson committed 31 days ago

Verified aa3b7a90

webui: fix keyboard shortcuts for new chat & edit chat title (#17007)

chansikpark committed 31 days ago

Verified 333f2595

vulkan: Use spec constants for conv2d s/d/p and kernel W/H (#16978)

jeffbolznv committed 31 days ago

Verified 53d7d21e

server: fix correct time_ms calculation in prompt_progress (#17093)

gSUz92nc committed 32 days ago

Verified eeee367d

Revert "CUDA: add expert reduce kernel (#16857)" (#17100)

am17an committed 32 days ago

Verified 64fe17fb

CUDA: skip fusion for repeating adds in bias (#17080)

am17an committed 32 days ago

Verified c1b18768

vulkan: Increase BK to 32; use BK/4 for non-CM mul_mm.comp (#16636)

SavicStefan committed 32 days ago

Verified b8a5cfd1

ggml: disable vxe for cross-compilation by default (#16966)

AlekseiNikiforovIBM committed 32 days ago

Verified 08416ebe

vulkan: fuse rms_norm + mul + rope (+ view + set_rows) (#16977)

jeffbolznv committed 32 days ago

Verified b4e335d8

vulkan: Fix test-thread-safety crashes (#17024)

jeffbolznv committed 32 days ago

Verified d6fe40fa

CUDA: fix MMQ stream-k fixup ne1 indices (#17089)

JohannesGaessler committed 32 days ago

Verified e14e842e

Older