ngxson/llama.cpp

Pull Requests Commits

ngxson committed 4 hours ago

6441ca72

ngxson committed 4 hours ago

68b6d86e

fix remote preset handling

ngxson committed 4 hours ago

0119dde2

Merge branch 'master' into xsn/server_remote_preset_test

ngxson committed 5 hours ago

7f9a2c39

server: add test for remote preset

ngxson committed 5 hours ago

f60aa470

ggml-webgpu: improve MTP inference by using mat-vec path for small batches (#24811)

yomaytk committed 6 hours ago

Verified 7c908502

codeowners: add yomaytk to ggml-webgpu (#24930)

yomaytk committed 7 hours ago

Verified 035cd8f9

server: improve user message detection and create checkpoints at every user message (#24176)

aldehir committed 8 hours ago

Verified 73618f27

opencl: q8_0 gemv precision improvement (#24923)

shawngu-quic committed 8 hours ago

Verified 23ee8797

server : Add id to tool call responses api (#24882)

boondocklabs committed 17 hours ago

Verified dec5ca55

ui: Prioritize favorite models in model selection (#24766)

mahdiou committed 19 hours ago

Verified 9c0ac887

server: (router) move model downloading to dedicated process (#24834)

ngxson committed 21 hours ago

Verified 721354fb

server: refactor/generalize input file schema (#24299)

ngxson committed 23 hours ago

Verified 6ee0f657

ui: model status and load progress via /models/sse feed (#24878)

ServeurpersoCom committed 1 day ago

Verified 099b579a

[SYCL] support bf16 on bin_bcast OP and unary OPs (#24838)

arthw committed 1 day ago

Verified f8cc15f1

sampling : remove unconditional softmax+sort in top-n-sigma sampler (#22645)

TimNN committed 1 day ago

Verified 37957e85

server: fix edit_file crash on append at end of file (line_start -1) (#24893)

ServeurpersoCom committed 1 day ago

Verified d0f9d2e5

docs/android.md: Add dependency `libandroid-spawn` for building in termux (#21812)

aafsmarak committed 1 day ago

Verified 0ef6f06d

common/peg : implement ac parser for stricter grammar generation (#24869)

aldehir committed 1 day ago

Verified 52b3df00

server: fix report progress for loading spec models, add "stages" list (#24870)

ngxson committed 1 day ago

Verified 7c082bc4

server: refactor batch construction (#24843)

ngxson committed 2 days ago

Verified bddfd2b1

mtmd: fix mtmd_get_memory_usage (#24867)

ngxson committed 2 days ago

Verified 0d135df4

jinja : implement call statement (#24847)

CISC committed 2 days ago

Verified bf533823

mtmd: add load progress callback (#24865)

ngxson committed 2 days ago

Verified 2f89acc2

server: add "verbose" field to schema (#24864)

ngxson committed 2 days ago

Verified bfa32191

server: real-time model load progress tracking via /models/sse (#24828)

ngxson committed 2 days ago

Verified d6d89958

minor : clean-up whitespaces (#24862)

ggerganov committed 2 days ago

Verified 8a118ee8

spec : Support Step3.5/3.7 flash mtp3 (#24340)

forforever73 committed 2 days ago

Verified d7895274

common/peg : refactor until gbnf grammar generation (#24839)

aldehir committed 2 days ago

Verified 063d9c15

common/json-schema-to-grammar : align spacing rules with parsers (#24835)

aldehir committed 2 days ago

Verified c5760701

Older