ngxson/llama.cpp

Pull Requests Commits

common : implement new jinja template engine (#18462)

ngxson committed 54 days ago

Verified c15395f7

Setting mmap and direct_io to false as default in llama-bench.cpp (#18841)

JTischbein committed 54 days ago

Verified aa1dc377

CANN: Remove unused `ggml_cann_get_device` function (#18625)

rauletorresc committed 54 days ago

Verified 4ea2eaac

CANN: fix an issue where get_env was not fully renamed (#18796)

noemotiovon committed 54 days ago

Verified e20fa27a

CANN: support gated linear attn (#18653)

hipudding committed 54 days ago

Verified baa4ba0a

OpenCL: add SOLVE_TRI op support (#18846)

shaofeiqi committed 54 days ago

Verified 785a7100

cuda : print less debug logs when disabling cuda graphs (#18868)

ggerganov committed 54 days ago

Verified 6e7fc8a1

context : do not reserve scheduler for warmups (#18867)

ggerganov committed 54 days ago

Verified be8e3d95

llama : add adaptive-p sampler (#17927)

ddh0 committed 54 days ago

Verified 13f1e4a9

server: improve slots scheduling for n_cmpl (#18789)

ngxson committed 54 days ago

Verified a04c2b06

context : reserve new scheduler when graph topology changes (#18547)

ggerganov committed 55 days ago

Verified 39173bca

CUDA: fix allignment on register spill for FA (#18815)

JohannesGaessler committed 55 days ago

Verified 5c662d21

ggml-cpu: optimize ggml_vec_dot_bf16 for Power9 (#18837)

shalinib-ibm committed 55 days ago

Verified 8cc0ba95

lora: make sure model keep track of associated adapters (#18490)

ngxson committed 55 days ago

Verified a7e6ddb8

model-loader : support bool array sliding window pattern (#18850)

CISC committed 55 days ago

Verified 2a131801

tests : download models only when running ctest (#18843)

angt committed 55 days ago

Verified ec997b4f

hexagon: support for OP_CPY, host buffers now optional, hvx-utils refactoring and optimizations (#18822)

max-krasnyansky committed 55 days ago

Verified cff777f2

CUDA: Factor out and re-use `block_reduce` function (#18785)

ORippler committed 55 days ago

Verified 36f01324

Restore clip's cb() to its rightful glory - extract common debugging elements in llama (#17914)

pwilkin committed 55 days ago

Verified d98b5481

model : clean up and fix EXAONE-MoE configuration (#18840)

nuxlear committed 55 days ago

Verified 8fb71755

refactor : remove libcurl, use OpenSSL when available (#18828)

angt committed 55 days ago

Verified 516a4ca9

vulkan: Check maxStorageBufferRange in supports_op (#18709)

jeffbolznv committed 56 days ago

Verified 3e4bb296

llama-model: fix unfortunate typo (#18832)

am17an committed 56 days ago

Verified 47f96124

CUDA : fix typo in clang pragma comment [no ci] (#18830)

danbev committed 56 days ago

Verified 01cbdfd7

vulkan: work around Intel fp16 bug in mmq (#18814)

0cc4m committed 56 days ago

Verified 635ef78e

ggml-metal: do not copy headers for embedded, use current binary dir for embedded (#18705)

DaAwesomeP committed 56 days ago

Verified 7d587e55

mmap: add Haiku support by skipping RLIMIT_MEMLOCK check (#18819)

danielbenjaminsson committed 56 days ago

Verified d34aa071

ci, tests : use cmake to download models and remove libcurl dependency (#18791)

angt committed 56 days ago

Verified f709c7a3

llama : print_info alignment fix (#18708)

ddh0 committed 56 days ago

Verified 6e36299b

model : add EXAONE MoE (#18543)

nuxlear committed 56 days ago

Verified 60591f01

Newer Older