ggerganov/llama.cpp

Pull Requests Commits

kv-cache : optimize KQ mask construction

ggerganov committed 19 hours ago

Verified edd29726

vulkan: Check maxStorageBufferRange in supports_op (#18709)

jeffbolznv committed 1 day ago

Verified 3e4bb296

llama-model: fix unfortunate typo (#18832)

am17an committed 1 day ago

Verified 47f96124

CUDA : fix typo in clang pragma comment [no ci] (#18830)

danbev committed 1 day ago

Verified 01cbdfd7

vulkan: work around Intel fp16 bug in mmq (#18814)

0cc4m committed 1 day ago

Verified 635ef78e

ggml-metal: do not copy headers for embedded, use current binary dir for embedded (#18705)

DaAwesomeP committed 1 day ago

Verified 7d587e55

mmap: add Haiku support by skipping RLIMIT_MEMLOCK check (#18819)

danielbenjaminsson committed 1 day ago

Verified d34aa071

ci, tests : use cmake to download models and remove libcurl dependency (#18791)

angt committed 1 day ago

Verified f709c7a3

llama : print_info alignment fix (#18708)

ddh0 committed 1 day ago

Verified 6e36299b

model : add EXAONE MoE (#18543)

nuxlear committed 1 day ago

Verified 60591f01

vocab : fix attribute overrides for harmony (#18806)

ggerganov committed 1 day ago

Verified e4832e3a

llama-mmap: fix direct-io loading fallback EOF exception (#18801)

0cc4m committed 1 day ago

Verified 960e5e3b

model-conversion : remove -c 0 from model card template [no ci] (#18807)

danbev committed 1 day ago

Verified 20ca2e12

HIP: add fattn-mma-f16 for RDNA4 (#18481)

zhang-hui-yulo committed 1 day ago

Verified ea4a321f

doc: ban AI-generated PR descriptions [no ci] (#18765)

JohannesGaessler committed 1 day ago

Verified c1e79e61

mtmd: fix use_non_causal being reported incorrectly (#18793)

ngxson committed 2 days ago

Verified e047f9ee

CUDA : fix unused argument when USE_CUDA_GRAPH=OFF (#18800)

ggerganov committed 2 days ago

Verified 0a57271a

graph : clean up t5 input builders (#18795)

gabe-l-hart committed 2 days ago

Verified 076b0faf

llama-bench: add direct_io parameter (#18778)

0cc4m committed 2 days ago

Verified db79dc06

ci : remove libcurl in releases (#18775)

angt committed 2 days ago

Verified 537d4240

server : add arg for disabling prompt caching (#18776)

rgerganov committed 2 days ago

Verified bcf75461

ci : use openssl for openEuler-latest-cmake-cann (#18779)

angt committed 2 days ago

Verified 36c5913c

vendor : update cpp-httplib to 0.30.1 (#18771)

angt committed 2 days ago

Verified 8e649571

examples : add --kv-unified to batched example (#18774)

danbev committed 2 days ago

Verified 4150da9a

vulkan: change memory_logger to be controlled by an env var (#18769)

jeffbolznv committed 2 days ago

Verified 8e2da778

server: update docs for sleeping [no ci] (#18777)

ngxson committed 2 days ago

Verified ce3bf9b1

vulkan: Use VK_EXT_shader_64bit_indexing to handle large mat_mul(_id) (#18678)

jeffbolznv committed 3 days ago

Verified 2bbe4c2c

vulkan: Disable large coopmat matmul configuration on proprietary AMD driver (#18763)

0cc4m committed 3 days ago

Verified 1051ecd2

model: fix qwen3next broken due to #18683 (#18762)

ngxson committed 3 days ago

Verified 0c3b7a9e

Vulkan: Optimize Matmul parameters for AMD GPUs with Coopmat support (#18749)

0cc4m committed 3 days ago

Verified 0e76501e

Older