ggerganov/llama.cpp

Pull Requests Commits

Merge branch 'master' into xsn/lora_keep_track

ggerganov committed 6 days ago

Verified 52929657

doc: ban AI-generated PR descriptions [no ci] (#18765)

JohannesGaessler committed 6 days ago

Verified c1e79e61

mtmd: fix use_non_causal being reported incorrectly (#18793)

ngxson committed 6 days ago

Verified e047f9ee

CUDA : fix unused argument when USE_CUDA_GRAPH=OFF (#18800)

ggerganov committed 6 days ago

Verified 0a57271a

graph : clean up t5 input builders (#18795)

gabe-l-hart committed 6 days ago

Verified 076b0faf

llama-bench: add direct_io parameter (#18778)

0cc4m committed 6 days ago

Verified db79dc06

ci : remove libcurl in releases (#18775)

angt committed 7 days ago

Verified 537d4240

server : add arg for disabling prompt caching (#18776)

rgerganov committed 7 days ago

Verified bcf75461

ci : use openssl for openEuler-latest-cmake-cann (#18779)

angt committed 7 days ago

Verified 36c5913c

vendor : update cpp-httplib to 0.30.1 (#18771)

angt committed 7 days ago

Verified 8e649571

examples : add --kv-unified to batched example (#18774)

danbev committed 7 days ago

Verified 4150da9a

vulkan: change memory_logger to be controlled by an env var (#18769)

jeffbolznv committed 7 days ago

Verified 8e2da778

server: update docs for sleeping [no ci] (#18777)

ngxson committed 7 days ago

Verified ce3bf9b1

minor : std::unordered_set over std::set

ggerganov committed 7 days ago

Verified 08b5d956

vulkan: Use VK_EXT_shader_64bit_indexing to handle large mat_mul(_id) (#18678)

jeffbolznv committed 7 days ago

Verified 2bbe4c2c

vulkan: Disable large coopmat matmul configuration on proprietary AMD driver (#18763)

0cc4m committed 8 days ago

Verified 1051ecd2

model: fix qwen3next broken due to #18683 (#18762)

ngxson committed 8 days ago

Verified 0c3b7a9e

Vulkan: Optimize Matmul parameters for AMD GPUs with Coopmat support (#18749)

0cc4m committed 8 days ago

Verified 0e76501e

security: make it clear about subtopics in server (#18754)

ngxson committed 8 days ago

Verified 4b060bf2

debug : include LLAMA_POOLING_TYPE_UNSPECIFIED in pooling check (#18692)

danbev committed 8 days ago

Verified 9789e284

tests : refactor test-backend-sampler (#18753)

ggerganov committed 8 days ago

Verified 84ae04f1

model: try to improve Qwen3 Next (#18683)

ngxson committed 8 days ago

Verified 506bb6e0

readme : update UIs (#18751)

thom-dev-fr committed 8 days ago

Verified 79456a69

security: narrow down the scope of what we consider a vulnerability (#18752)

ngxson committed 8 days ago

Verified 28068af7

opencl: add SOFTPLUS op support (#18726)

shaofeiqi committed 9 days ago

Verified 707cbafc

test-backend-ops: fix mxfp4 tests on blackwell (#18736)

am17an committed 9 days ago

Verified b1377188

HIP: adjust RDNA3.5 MMQ kernel selction logic (#18666)

JohannesGaessler committed 9 days ago

Verified d2ff4e23

cmake : update blas logic (#18205)

DaAwesomeP committed 9 days ago

Verified 657a2e64

server : adjust unified KV cache tests (#18716)

ggerganov committed 9 days ago

Verified f3079264

scripts : follow api redirects in pr2wt.sh (#18739)

CISC committed 9 days ago

Verified 7fdc8c89

Older