ggerganov/llama.cpp

Pull Requests Commits

vulkan: add mmq q2_k integer dot support

0cc4m committed 11 days ago

0d9813fa

Show message actions by default (#16289)

allozaur committed 12 days ago

Verified 4807e8f9

CUDA: mul_mat_id for mmf for bs <= 64 for f16 and bs <= 32 for f32 (#16277)

am17an committed 12 days ago

Verified c0bfc57a

CUDA: refactor and deduplicate vector FA kernels (#16208)

JohannesGaessler committed 12 days ago

Verified 75a3a6c2

vulkan: throw system error instead of SIGABRT during init on older devices (#16156)

DmyMi committed 12 days ago

Verified 0499b29c

server : remove old LLAMA_SERVER_SSL (#16290)

angt committed 12 days ago

Verified 234e2ff8

vulkan: support GET_ROWS for k-quants (#16235)

jeffbolznv committed 12 days ago

Verified 3f81b4e9

build : add LLAMA_OPENSSL option (#16287)

angt committed 12 days ago

Verified ace6a545

model : make minicpm embedding_scale, residual_scale and logit_scale optional with legacy defaults (#16273)

vinkal-chudgar committed 13 days ago

Verified 72b24d96

devops: add s390x & ppc64le CI (#15925)

taronaeo committed 13 days ago

Verified 624207e6

Enhance text file detection logic for file attachments (#16199)

allozaur committed 13 days ago

Verified 807e8c6d

Allow viewing conversations even when llama server is down (#16255)

allozaur committed 13 days ago

Verified 1a189278

webui: switch to hash-based routing (alternative of #16079) (#16157)

isaac-mcfadyen committed 13 days ago

Verified e0539eb6

Always show message actions for mobile UI + improvements for user message sizing (#16076)

allozaur committed 13 days ago

Verified 5d0a40f3

codeowners : add rgerganov as owner of RPC [no ci] (#16279)

rgerganov committed 13 days ago

Verified d12a9836

mtmd : fix uninitialized variable in bicubic_resize (#16275)

AlekseiNikiforovIBM committed 13 days ago

Verified cc1cfa27

metal : report OOM errors (#16274)

ggerganov committed 13 days ago

Verified 54dbc370

common : use cpp-httplib as a cURL alternative for downloads (#16185)

angt committed 13 days ago

Verified b995a107

build : fix build-ios-device (#16257)

angt committed 13 days ago

Verified 4710dd31

ggml-cpu: implement MXFP4 SIMD for s390x (#16193)

taronaeo committed 13 days ago

Verified 9b265118

ci : create git tags for released docker images (#16008)

rgerganov committed 13 days ago

Verified 00217cd4

codeowners : add danbev as owner of build-xcframework.sh [no ci] (#16268)

danbev committed 13 days ago

Verified 3b337b01

musa: upgrade musa sdk to 4.3.0 (#16240)

yeahdongcn committed 13 days ago

Verified a86a580a

musa: fix build warnings (#15611)

yeahdongcn committed 13 days ago

Verified 0f7c6968

model : add GroveMoE support (#15510)

CISC committed 14 days ago

Verified 835b2b91

vendors: update miniaudio version (#16212)

taronaeo committed 14 days ago

Verified b05a9d65

readme : update bindings (#16144)

romantal committed 14 days ago

Verified 27052978

CUDA: add a fused top-K MoE kernel (#16130)

am17an committed 14 days ago

Verified 077c94d0

model-conversion : add embedding prompt file support (#15871)

danbev committed 14 days ago

Verified aa3ee0eb

server : add support for external server for tests (#16243)

danbev committed 14 days ago

Verified d0991da3

Older