ngxson/llama.cpp

Pull Requests Commits

server-stream: update dev docs for the improved API

ServeurpersoCom committed 1 hour ago

92fe35e5

improve server_stream_create_spipe

ngxson committed 15 hours ago

b14866d5

ngxson committed 15 hours ago

2e57eab0

move server_res_spipe

ngxson committed 15 hours ago

8fdeed18

remove non-thread-safe rd.stop() call

ngxson committed 15 hours ago

49740212

ngxson committed 16 hours ago

0ad9493f

server: refactoring, remove spipe from server_http_res

ngxson committed 17 hours ago

b58a8a79

llama : make tensor-split regex patterns static (#24710)

eduardopessin committed 19 hours ago

Verified c749cb04

hexagon: improve ARGSORT performance for small tensors (#25512)

max-krasnyansky committed 20 hours ago

Verified 67776eae

arg: prevent duplicate spec model downloads (#25527)

ngxson committed 21 hours ago

Verified 22b69b6e

mtmd: deepseek-ocr v1 multi-tile (#24717)

ngxson committed 22 hours ago

Verified 3e706dd5

feat: pre-select models in the webui using alias (#25492)

felix314159 committed 23 hours ago

Verified 07d93782

ui: use server modalities in non-router mode (#24874)

coder543 committed 23 hours ago

Verified 9f623c68

server: remove loading.html (#25500)

ngxson committed 23 hours ago

Verified a935fbff

ggerganov committed 1 day ago

0badc06a

ggml : use ggml_vqtbl1q_u8 for 32-bit compat (whisper/0)

ggerganov committed 1 day ago

ac17f8ac

server: improve tools, remove apply_diff (#25498)

ngxson committed 1 day ago

Verified c4ae9a88

cli: fix crash on wrong server base url (#25497)

marcoStocchi committed 1 day ago

Verified 1b9691bc

ui: prevent tooltip from flickering open and closed on hover (#25503)

ServeurpersoCom committed 1 day ago

Verified c7af942e

sync : ggml (#25517)

ggerganov committed 1 day ago

Verified 8f114a9b

ui: export full message tree instead of active path only (#25501)

ServeurpersoCom committed 1 day ago

Verified d46786f2

llama : make all KQ masks f16 if FA is used, remove zero attention bias, remove raw_k repeats in DeepSeek V4 (#25370)

fairydreaming committed 1 day ago

Verified 2ed3c1ab

ggml-et: Initial ET backend (#24179)

marty1885 committed 1 day ago

Verified 082b326f

llama-batch: add unit test (#25471)

am17an committed 1 day ago

Verified 961e4b26

opencl: cluster-parallel decode FA for Adreno (#25473)

wanghqc committed 1 day ago

Verified 049326a0

ggml : process data in smaller chunks in CUDA ggml_top_k() and ggml_argsort() to reduce temporary buffers memory usage (#24776)

fairydreaming committed 1 day ago

Verified 07494499

cli: add --output option (#25484)

ngxson committed 1 day ago

Verified 3de7dd4c

hexagon: tiling, tracing and optimizations for unary ops (#25474)

aparmp-quic committed 1 day ago

Verified fb30ba9a

server : move chat-template thinking probe inside the init try/catch (#24093)

palios-taey committed 1 day ago

Verified 82fce65d

ggml : fix conv 2d dw (#25490)

ggerganov committed 1 day ago

Verified 5c3a5868

Older