ggerganov/llama.cpp

Pull Requests Commits

use destructor instead

ngxson committed 4 days ago

a432e6f8

remove outdated comment

ngxson committed 4 days ago

5d67f69f

Apply suggestions from code review

ngxson committed 4 days ago

Verified beef5cf0

case: router with only one model

ngxson committed 4 days ago

b093e468

cli support router mode

ngxson committed 4 days ago

1401fc3c

remote server ok

ngxson committed 4 days ago

85c58bbc

ngxson committed 4 days ago

19296c17

Merge branch 'master' into xsn/cli_http_based

ngxson committed 5 days ago

90c111bf

server: fix remote preset handling, add test (#24938)

ngxson committed 5 days ago

Verified 75ad0b23

ngxson committed 5 days ago

f7421eab

cli: move to HTTP-based implementation

ngxson committed 5 days ago

59797670

vulkan: link ggml-cpu when GGML_VULKAN_CHECK_RESULTS / RUN_TESTS are enabled (#24444)

Detensable committed 5 days ago

Verified c926ad09

model: Granite Speech Plus (#24818)

gabe-l-hart committed 5 days ago

Verified a3900a66

ggml-webgpu: improve MTP inference by using mat-vec path for small batches (#24811)

yomaytk committed 5 days ago

Verified 7c908502

codeowners: add yomaytk to ggml-webgpu (#24930)

yomaytk committed 5 days ago

Verified 035cd8f9

server: improve user message detection and create checkpoints at every user message (#24176)

aldehir committed 5 days ago

Verified 73618f27

opencl: q8_0 gemv precision improvement (#24923)

shawngu-quic committed 5 days ago

Verified 23ee8797

server : Add id to tool call responses api (#24882)

boondocklabs committed 5 days ago

Verified dec5ca55

ui: Prioritize favorite models in model selection (#24766)

mahdiou committed 5 days ago

Verified 9c0ac887

server: (router) move model downloading to dedicated process (#24834)

ngxson committed 5 days ago

Verified 721354fb

server: refactor/generalize input file schema (#24299)

ngxson committed 5 days ago

Verified 6ee0f657

ui: model status and load progress via /models/sse feed (#24878)

ServeurpersoCom committed 6 days ago

Verified 099b579a

[SYCL] support bf16 on bin_bcast OP and unary OPs (#24838)

arthw committed 6 days ago

Verified f8cc15f1

sampling : remove unconditional softmax+sort in top-n-sigma sampler (#22645)

TimNN committed 6 days ago

Verified 37957e85

server: fix edit_file crash on append at end of file (line_start -1) (#24893)

ServeurpersoCom committed 6 days ago

Verified d0f9d2e5

docs/android.md: Add dependency `libandroid-spawn` for building in termux (#21812)

aafsmarak committed 6 days ago

Verified 0ef6f06d

common/peg : implement ac parser for stricter grammar generation (#24869)

aldehir committed 6 days ago

Verified 52b3df00

server: fix report progress for loading spec models, add "stages" list (#24870)

ngxson committed 6 days ago

Verified 7c082bc4

server: refactor batch construction (#24843)

ngxson committed 7 days ago

Verified bddfd2b1

mtmd: fix mtmd_get_memory_usage (#24867)

ngxson committed 7 days ago

Verified 0d135df4

Older