ggerganov/llama.cpp

Pull Requests Commits

cuda : fix build on cuda 12.8 (#18672)

olliewalsh committed 25 days ago

Verified f5245b5e

fix(docker): add missing libglvnd libraries to Vulkan image (#18664)

686f6c61 committed 26 days ago

Verified ae9f8df7

tools : remove llama-run (#18661)

angt committed 26 days ago

Verified 56d2fed2

scripts : add pr2wt.sh (#18644)

ggerganov committed 26 days ago

Verified 56426673

convert : clarify sentence-transformers-dense-modules help [no ci] (#18662)

danbev committed 26 days ago

Verified bb77764c

ci : run cann build unconditionally [no ci] (#18659)

CISC committed 26 days ago

Verified 9dfa8ee9

vulkan: reject ops when a tensor is too large to allocate (#18646)

jeffbolznv committed 26 days ago

Verified ca4a8370

vulkan: Warptile tuning for Intel Xe2/Xe3 (#18178)

virajwad committed 26 days ago

Verified 03023296

vulkan: more mul mat optimizations (#18533)

netrunnereve committed 26 days ago

Verified 8c77a04c

examples : add debug utility/example (#18464)

danbev committed 26 days ago

Verified ffba4f29

CANN: Fix rename for get_env (#18652)

hipudding committed 26 days ago

Verified 3333951d

CANN: Rename `get_env` to `get_env_as_lowercase` (#18624)

rauletorresc committed 26 days ago

Verified 193ee38a

Hexagon add support for f16/f32 flash attention, scale, set-rows and improve f16/32 matmul (#18611)

max-krasnyansky committed 26 days ago

Verified 95ea9e08

mtmd: mtmd_audio_streaming_istft (#18645)

tdakhran committed 26 days ago

Verified ccbc84a5

llama-params-fit: fix last devices with low VRAM (#18494)

JohannesGaessler committed 26 days ago

Verified 68b4d516

ggml : optimize cuda ssm_scan using warp-level reduction (#18505)

Aadeshveer committed 26 days ago

Verified 24af22fc

arg: use CSV escape style for multiple-value args (#18643)

ngxson committed 27 days ago

Verified 07fbe19f

vulkan: support buffer_from_host_ptr (#18467)

jeffbolznv committed 27 days ago

Verified ea13cba8

ggml-cuda: refactor cuda graph usage (#18637)

am17an committed 27 days ago

Verified 090b137e

mmq.cu: tune mmq/rocblas switching for RDNA (#18537)

Beinsezii committed 27 days ago

Verified 96892952

server : add thinking content blocks to Anthropic Messages API (#18551)

686f6c61 committed 27 days ago

Verified 3d26a09d

gguf-py : add requests to dependencies (#18629)

ckastner committed 27 days ago

Verified bd2a93d4

ggml : fix avx512bf16 build (#18623)

angt committed 27 days ago

Verified e75ee110

CANN: Make `valid_values` variable `static const` (#18627)

rauletorresc committed 27 days ago

Verified da9b8d33

ggml webgpu: add CEIL operation support (#18605)

tnguyen21 committed 27 days ago

Verified e443fbcf

model : add LFM2-ColBert-350M (#18607)

tdakhran committed 27 days ago

Verified 73d284a2

CUDA: fix FA FP16 accumulator overflow for Granite (#18614)

JohannesGaessler committed 27 days ago

Verified df17a4c9

add YoutuVLForConditionalGeneration architectures (#18620)

f291400 committed 27 days ago

Verified 1871f0ba

ggml-cuda: check for srcs outside the cgraph (#18583)

am17an committed 28 days ago

Verified f47edb8c

server : fix router child env in containerized environments (#18562)

v-sayapin committed 28 days ago

Verified da143b99

Newer Older