ggerganov/llama.cpp

Pull Requests Commits

add arg --threads-sampling

ngxson committed 7 days ago

095058ca

ngxson committed 7 days ago

c62fdd5f

ngxson committed 7 days ago

41ed530b

server: run sampling in a threadpool

ngxson committed 7 days ago

fe03cce8

server: (router) move model downloading to dedicated process (#24834)

ngxson committed 7 days ago

Verified 721354fb

server: refactor/generalize input file schema (#24299)

ngxson committed 7 days ago

Verified 6ee0f657

ui: model status and load progress via /models/sse feed (#24878)

ServeurpersoCom committed 7 days ago

Verified 099b579a

[SYCL] support bf16 on bin_bcast OP and unary OPs (#24838)

arthw committed 8 days ago

Verified f8cc15f1

sampling : remove unconditional softmax+sort in top-n-sigma sampler (#22645)

TimNN committed 8 days ago

Verified 37957e85

server: fix edit_file crash on append at end of file (line_start -1) (#24893)

ServeurpersoCom committed 8 days ago

Verified d0f9d2e5

docs/android.md: Add dependency `libandroid-spawn` for building in termux (#21812)

aafsmarak committed 8 days ago

Verified 0ef6f06d

common/peg : implement ac parser for stricter grammar generation (#24869)

aldehir committed 8 days ago

Verified 52b3df00

server: fix report progress for loading spec models, add "stages" list (#24870)

ngxson committed 8 days ago

Verified 7c082bc4

server: refactor batch construction (#24843)

ngxson committed 8 days ago

Verified bddfd2b1

mtmd: fix mtmd_get_memory_usage (#24867)

ngxson committed 8 days ago

Verified 0d135df4

jinja : implement call statement (#24847)

CISC committed 8 days ago

Verified bf533823

mtmd: add load progress callback (#24865)

ngxson committed 8 days ago

Verified 2f89acc2

server: add "verbose" field to schema (#24864)

ngxson committed 9 days ago

Verified bfa32191

server: real-time model load progress tracking via /models/sse (#24828)

ngxson committed 9 days ago

Verified d6d89958

minor : clean-up whitespaces (#24862)

ggerganov committed 9 days ago

Verified 8a118ee8

spec : Support Step3.5/3.7 flash mtp3 (#24340)

forforever73 committed 9 days ago

Verified d7895274

common/peg : refactor until gbnf grammar generation (#24839)

aldehir committed 9 days ago

Verified 063d9c15

common/json-schema-to-grammar : align spacing rules with parsers (#24835)

aldehir committed 9 days ago

Verified c5760701

fix(hexagon): use padded stride for ssm-conv weights (#24470)

BiReRa committed 9 days ago

Verified 4a809431

llama : use LLM_KV for quantization_version & file_type (#24802)

angt committed 9 days ago

Verified 84de01a1

arg: try fixing test-args-parser randomly fails (#24826)

ngxson committed 9 days ago

Verified 75f460ac

release: add missing link for win opencl adreno arm64 (#24809)

muhammad-salem committed 9 days ago

Verified 84528246

server: avoid forwarding auth headers in CORS proxy (#24373)

ItsMatti4 committed 9 days ago

Verified e27f3085

docker : prebuild web UI for s390x build [no release] (#24829)

aldehir committed 10 days ago

Verified 67e9fd3b

model : glm-dsa load DSA indexer tensors as optional (#24770)

davidrhodus committed 10 days ago

Verified 796f41be

Older