ggerganov/llama.cpp

Pull Requests Commits

server : prevent LRU eviction of models still loading

ggerganov committed 4 hours ago

3203ab47

ggerganov committed 7 hours ago

0badc06a

ggml : use ggml_vqtbl1q_u8 for 32-bit compat (whisper/0)

ggerganov committed 7 hours ago

ac17f8ac

server: improve tools, remove apply_diff (#25498)

ngxson committed 8 hours ago

Verified c4ae9a88

cli: fix crash on wrong server base url (#25497)

marcoStocchi committed 8 hours ago

Verified 1b9691bc

ui: prevent tooltip from flickering open and closed on hover (#25503)

ServeurpersoCom committed 8 hours ago

Verified c7af942e

sync : ggml (#25517)

ggerganov committed 10 hours ago

Verified 8f114a9b

ui: export full message tree instead of active path only (#25501)

ServeurpersoCom committed 10 hours ago

Verified d46786f2

llama : make all KQ masks f16 if FA is used, remove zero attention bias, remove raw_k repeats in DeepSeek V4 (#25370)

fairydreaming committed 10 hours ago

Verified 2ed3c1ab

ggml-et: Initial ET backend (#24179)

marty1885 committed 13 hours ago

Verified 082b326f

llama-batch: add unit test (#25471)

am17an committed 15 hours ago

Verified 961e4b26

opencl: cluster-parallel decode FA for Adreno (#25473)

wanghqc committed 23 hours ago

Verified 049326a0

ggml : process data in smaller chunks in CUDA ggml_top_k() and ggml_argsort() to reduce temporary buffers memory usage (#24776)

fairydreaming committed 23 hours ago

Verified 07494499

cli: add --output option (#25484)

ngxson committed 1 day ago

Verified 3de7dd4c

hexagon: tiling, tracing and optimizations for unary ops (#25474)

aparmp-quic committed 1 day ago

Verified fb30ba9a

server : move chat-template thinking probe inside the init try/catch (#24093)

palios-taey committed 1 day ago

Verified 82fce65d

ggml : fix conv 2d dw (#25490)

ggerganov committed 1 day ago

Verified 5c3a5868

meta: add hard emphasis on agents not writing descriptions/comments (#25480)

pwilkin committed 1 day ago

Verified c15c5c77

Refactor: Consistently use smart pointers in `test-backend-ops` (#25440)

ORippler committed 1 day ago

Verified f84a5194

Only index by compile times + always multiply/add (#25445)

ORippler committed 1 day ago

Verified 683f0c72

llama-bench : init params.offline (#25476)

angt committed 1 day ago

Verified 259f2e2a

metal : add CONV_2D_DW (depthwise convolution) support (#21565)

Sou-ly committed 1 day ago

Verified 92b187c9

ggml-hip: enable -funsafe-math-optimizations (#24668)

RapidMark committed 1 day ago

Verified ccb0c342

cuda: align snake fusion matcher with the other backends (#25460)

ServeurpersoCom committed 1 day ago

Verified 2021515a

server : respect min-step when splitting prompt batches (#25420)

aldehir committed 1 day ago

Verified 64c8b7db

hexagon: add VISION RoPE support (#25216)

aparmp-quic committed 1 day ago

Verified f2d1c2f3

ggml-webgpu: tune subgroup split (d_split) in flash_attn_vec (#25418)

yomaytk committed 1 day ago

Verified 32e41fa5

opencl: Q6_K GEMM/GEMV fix for ne01 of weights that are not multiples of 128. (#25464)

wanghqc committed 1 day ago

Verified 92366df3

vulkan: disable FA mask_opt on GCN to improve performance (#24362)

0cc4m committed 2 days ago

Verified a646006f

opencl: ragged-tile MoE prefill FP16 GEMM optimization (skip padded expert tiles) (#25433)

wanghqc committed 2 days ago

Verified 167d0576

Older