ggerganov/llama.cpp

Pull Requests Commits

ggml : remove KQ mask padding

ggerganov committed 11 days ago

Verified 837b1b45

metal : remove mask padding requirement

ggerganov committed 11 days ago

Verified 46c338fc

metal : add comments

ggerganov committed 11 days ago

Verified 50d2b21d

cuda : add TODO about KV padding requirement

ggerganov committed 11 days ago

Verified 06294376

cont : simplify

ggerganov committed 11 days ago

Verified 66692977

metal : pad K, V and Mask when needed

ggerganov committed 11 days ago

Verified 5d0d2d22

vulkan: 64-bit im2col (#16135)

jeffbolznv committed 11 days ago

Verified d8359f5f

metal : extend mat-mat multiplication support (#16225)

ggerganov committed 11 days ago

Verified 6a2c6145

metal : fuse non-sequential nodes (#16102)

ggerganov committed 11 days ago

Verified 3b53634f

vulkan: handle mat_mul with A matrix > 4GB (#16176)

jeffbolznv committed 11 days ago

Verified 1384abf8

vulkan: support arbitrary KV dimension in flash attention (#16160)

jeffbolznv committed 11 days ago

Verified e6d65fb0

vulkan : make the vulkan.hpp dynamic dispatcher instance private (#16224)

Acly committed 11 days ago

Verified 8656f5de

Show message actions by default (#16289)

allozaur committed 12 days ago

Verified 4807e8f9

CUDA: mul_mat_id for mmf for bs <= 64 for f16 and bs <= 32 for f32 (#16277)

am17an committed 12 days ago

Verified c0bfc57a

CUDA: refactor and deduplicate vector FA kernels (#16208)

JohannesGaessler committed 12 days ago

Verified 75a3a6c2

vulkan: throw system error instead of SIGABRT during init on older devices (#16156)

DmyMi committed 12 days ago

Verified 0499b29c

server : remove old LLAMA_SERVER_SSL (#16290)

angt committed 12 days ago

Verified 234e2ff8

vulkan: support GET_ROWS for k-quants (#16235)

jeffbolznv committed 12 days ago

Verified 3f81b4e9

build : add LLAMA_OPENSSL option (#16287)

angt committed 12 days ago

Verified ace6a545

model : make minicpm embedding_scale, residual_scale and logit_scale optional with legacy defaults (#16273)

vinkal-chudgar committed 12 days ago

Verified 72b24d96

devops: add s390x & ppc64le CI (#15925)

taronaeo committed 13 days ago

Verified 624207e6

Enhance text file detection logic for file attachments (#16199)

allozaur committed 13 days ago

Verified 807e8c6d

Allow viewing conversations even when llama server is down (#16255)

allozaur committed 13 days ago

Verified 1a189278

webui: switch to hash-based routing (alternative of #16079) (#16157)

isaac-mcfadyen committed 13 days ago

Verified e0539eb6

Always show message actions for mobile UI + improvements for user message sizing (#16076)

allozaur committed 13 days ago

Verified 5d0a40f3

codeowners : add rgerganov as owner of RPC [no ci] (#16279)

rgerganov committed 13 days ago

Verified d12a9836

mtmd : fix uninitialized variable in bicubic_resize (#16275)

AlekseiNikiforovIBM committed 13 days ago

Verified cc1cfa27

metal : report OOM errors (#16274)

ggerganov committed 13 days ago

Verified 54dbc370

common : use cpp-httplib as a cURL alternative for downloads (#16185)

angt committed 13 days ago

Verified b995a107

build : fix build-ios-device (#16257)

angt committed 13 days ago

Verified 4710dd31

Older