ngxson/llama.cpp

Pull Requests Commits

model: fix qwen3next broken due to #18683

ngxson committed 3 days ago

b356e5b7

Vulkan: Optimize Matmul parameters for AMD GPUs with Coopmat support (#18749)

0cc4m committed 3 days ago

Verified 0e76501e

security: make it clear about subtopics in server (#18754)

ngxson committed 3 days ago

Verified 4b060bf2

debug : include LLAMA_POOLING_TYPE_UNSPECIFIED in pooling check (#18692)

danbev committed 3 days ago

Verified 9789e284

tests : refactor test-backend-sampler (#18753)

ggerganov committed 3 days ago

Verified 84ae04f1

model: try to improve Qwen3 Next (#18683)

ngxson committed 3 days ago

Verified 506bb6e0

readme : update UIs (#18751)

thom-dev-fr committed 3 days ago

Verified 79456a69

security: narrow down the scope of what we consider a vulnerability (#18752)

ngxson committed 3 days ago

Verified 28068af7

opencl: add SOFTPLUS op support (#18726)

shaofeiqi committed 3 days ago

Verified 707cbafc

test-backend-ops: fix mxfp4 tests on blackwell (#18736)

am17an committed 4 days ago

Verified b1377188

HIP: adjust RDNA3.5 MMQ kernel selction logic (#18666)

JohannesGaessler committed 4 days ago

Verified d2ff4e23

cmake : update blas logic (#18205)

DaAwesomeP committed 4 days ago

Verified 657a2e64

server : adjust unified KV cache tests (#18716)

ggerganov committed 4 days ago

Verified f3079264

scripts : follow api redirects in pr2wt.sh (#18739)

CISC committed 4 days ago

Verified 7fdc8c89

preset: allow named remote preset (#18728)

ngxson committed 4 days ago

Verified 23f82f24

docs(ggml): update backend ops (#18734)

taronaeo committed 4 days ago

Verified 2656c0d2

Corrected: changed s13 = src1->nb[3] instead of nb[2] (#18724)

michaelw9999 committed 4 days ago

Verified 600a3664

common : add --license to display embedded licenses (#18696)

angt committed 4 days ago

Verified ea23c159

server: fix n_cmpl not skipping processing prompt (#18663)

ngxson committed 5 days ago

Verified 9ac2693a

mtmd: Add Gemma3n multimodal support with MobileNetV5 vision encoder (#18256)

simrnsingh committed 5 days ago

Verified a61c8bc3

opencl: add EXPM1 op (#18704)

shaofeiqi committed 5 days ago

Verified 593da7fa

Updates to webgpu get_memory (#18707)

reeselevine committed 5 days ago

Verified 9e41884d

Webui/file upload (#18694)

ServeurpersoCom committed 5 days ago

Verified ec8fd787

cmake: only build cli when server is enabled (#18670)

AsbjornOlling committed 5 days ago

Verified a180ba78

server : fix timing of prompt/generation (#18713)

ggerganov committed 5 days ago

Verified 53eb9435

scripts : pr2wt.sh reset to remote head (#18695)

ggerganov committed 5 days ago

Verified d3435efc

server : use different seeds for child completions (#18700)

ggerganov committed 5 days ago

Verified f5f8812f

common: support remote preset (#18520)

ngxson committed 6 days ago

Verified 8ece3836

llama: use host memory if device reports 0 memory (#18587)

taronaeo committed 6 days ago

Verified 046d5fd4

ggml-webgpu: Fix GGML_MEM_ALIGN to 8 for emscripten. (#18628)

yomaytk committed 6 days ago

Verified 480160d4

Older