ggerganov/llama.cpp

Pull Requests Commits

CUDA: Factor out and re-use `block_reduce` function (#18785)

ORippler committed 38 days ago

Verified 36f01324

Restore clip's cb() to its rightful glory - extract common debugging elements in llama (#17914)

pwilkin committed 38 days ago

Verified d98b5481

model : clean up and fix EXAONE-MoE configuration (#18840)

nuxlear committed 38 days ago

Verified 8fb71755

refactor : remove libcurl, use OpenSSL when available (#18828)

angt committed 38 days ago

Verified 516a4ca9

vulkan: Check maxStorageBufferRange in supports_op (#18709)

jeffbolznv committed 39 days ago

Verified 3e4bb296

llama-model: fix unfortunate typo (#18832)

am17an committed 39 days ago

Verified 47f96124

CUDA : fix typo in clang pragma comment [no ci] (#18830)

danbev committed 39 days ago

Verified 01cbdfd7

vulkan: work around Intel fp16 bug in mmq (#18814)

0cc4m committed 39 days ago

Verified 635ef78e

ggml-metal: do not copy headers for embedded, use current binary dir for embedded (#18705)

DaAwesomeP committed 39 days ago

Verified 7d587e55

mmap: add Haiku support by skipping RLIMIT_MEMLOCK check (#18819)

danielbenjaminsson committed 39 days ago

Verified d34aa071

ci, tests : use cmake to download models and remove libcurl dependency (#18791)

angt committed 39 days ago

Verified f709c7a3

llama : print_info alignment fix (#18708)

ddh0 committed 39 days ago

Verified 6e36299b

model : add EXAONE MoE (#18543)

nuxlear committed 39 days ago

Verified 60591f01

vocab : fix attribute overrides for harmony (#18806)

ggerganov committed 39 days ago

Verified e4832e3a

llama-mmap: fix direct-io loading fallback EOF exception (#18801)

0cc4m committed 39 days ago

Verified 960e5e3b

model-conversion : remove -c 0 from model card template [no ci] (#18807)

danbev committed 39 days ago

Verified 20ca2e12

HIP: add fattn-mma-f16 for RDNA4 (#18481)

zhang-hui-yulo committed 40 days ago

Verified ea4a321f

doc: ban AI-generated PR descriptions [no ci] (#18765)

JohannesGaessler committed 40 days ago

Verified c1e79e61

mtmd: fix use_non_causal being reported incorrectly (#18793)

ngxson committed 40 days ago

Verified e047f9ee

CUDA : fix unused argument when USE_CUDA_GRAPH=OFF (#18800)

ggerganov committed 40 days ago

Verified 0a57271a

graph : clean up t5 input builders (#18795)

gabe-l-hart committed 40 days ago

Verified 076b0faf

llama-bench: add direct_io parameter (#18778)

0cc4m committed 40 days ago

Verified db79dc06

ci : remove libcurl in releases (#18775)

angt committed 40 days ago

Verified 537d4240

server : add arg for disabling prompt caching (#18776)

rgerganov committed 40 days ago

Verified bcf75461

ci : use openssl for openEuler-latest-cmake-cann (#18779)

angt committed 40 days ago

Verified 36c5913c

vendor : update cpp-httplib to 0.30.1 (#18771)

angt committed 40 days ago

Verified 8e649571

examples : add --kv-unified to batched example (#18774)

danbev committed 41 days ago

Verified 4150da9a

vulkan: change memory_logger to be controlled by an env var (#18769)

jeffbolznv committed 41 days ago

Verified 8e2da778

server: update docs for sleeping [no ci] (#18777)

ngxson committed 41 days ago

Verified ce3bf9b1

vulkan: Use VK_EXT_shader_64bit_indexing to handle large mat_mul(_id) (#18678)

jeffbolznv committed 41 days ago

Verified 2bbe4c2c

Older