ngxson/llama.cpp

Pull Requests Commits

ngxson committed 45 days ago

6441ca72

ngxson committed 45 days ago

68b6d86e

fix remote preset handling

ngxson committed 45 days ago

0119dde2

Merge branch 'master' into xsn/server_remote_preset_test

ngxson committed 45 days ago

7f9a2c39

server: add test for remote preset

ngxson committed 45 days ago

f60aa470

ggml-webgpu: improve MTP inference by using mat-vec path for small batches (#24811)

yomaytk committed 45 days ago

Verified 7c908502

codeowners: add yomaytk to ggml-webgpu (#24930)

yomaytk committed 45 days ago

Verified 035cd8f9

server: improve user message detection and create checkpoints at every user message (#24176)

aldehir committed 45 days ago

Verified 73618f27

opencl: q8_0 gemv precision improvement (#24923)

shawngu-quic committed 45 days ago

Verified 23ee8797

server : Add id to tool call responses api (#24882)

boondocklabs committed 46 days ago

Verified dec5ca55

ui: Prioritize favorite models in model selection (#24766)

mahdiou committed 46 days ago

Verified 9c0ac887

server: (router) move model downloading to dedicated process (#24834)

ngxson committed 46 days ago

Verified 721354fb

server: refactor/generalize input file schema (#24299)

ngxson committed 46 days ago

Verified 6ee0f657

ui: model status and load progress via /models/sse feed (#24878)

ServeurpersoCom committed 46 days ago

Verified 099b579a

[SYCL] support bf16 on bin_bcast OP and unary OPs (#24838)

arthw committed 46 days ago

Verified f8cc15f1

sampling : remove unconditional softmax+sort in top-n-sigma sampler (#22645)

TimNN committed 46 days ago

Verified 37957e85

server: fix edit_file crash on append at end of file (line_start -1) (#24893)

ServeurpersoCom committed 46 days ago

Verified d0f9d2e5

docs/android.md: Add dependency `libandroid-spawn` for building in termux (#21812)

aafsmarak committed 46 days ago

Verified 0ef6f06d

common/peg : implement ac parser for stricter grammar generation (#24869)

aldehir committed 47 days ago

Verified 52b3df00

server: fix report progress for loading spec models, add "stages" list (#24870)

ngxson committed 47 days ago

Verified 7c082bc4

server: refactor batch construction (#24843)

ngxson committed 47 days ago

Verified bddfd2b1

mtmd: fix mtmd_get_memory_usage (#24867)

ngxson committed 47 days ago

Verified 0d135df4

jinja : implement call statement (#24847)

CISC committed 47 days ago

Verified bf533823

mtmd: add load progress callback (#24865)

ngxson committed 47 days ago

Verified 2f89acc2

server: add "verbose" field to schema (#24864)

ngxson committed 47 days ago

Verified bfa32191

server: real-time model load progress tracking via /models/sse (#24828)

ngxson committed 47 days ago

Verified d6d89958

minor : clean-up whitespaces (#24862)

ggerganov committed 47 days ago

Verified 8a118ee8

spec : Support Step3.5/3.7 flash mtp3 (#24340)

forforever73 committed 47 days ago

Verified d7895274

common/peg : refactor until gbnf grammar generation (#24839)

aldehir committed 47 days ago

Verified 063d9c15

common/json-schema-to-grammar : align spacing rules with parsers (#24835)

aldehir committed 48 days ago

Verified c5760701

Older