ggerganov/llama.cpp

Pull Requests Commits

vulkan: split ggml-vulkan.cpp file

0cc4m committed 7 days ago

03739779

[SYCL] support bf16 on bin_bcast OP and unary OPs (#24838)

arthw committed 7 days ago

Verified f8cc15f1

sampling : remove unconditional softmax+sort in top-n-sigma sampler (#22645)

TimNN committed 7 days ago

Verified 37957e85

server: fix edit_file crash on append at end of file (line_start -1) (#24893)

ServeurpersoCom committed 7 days ago

Verified d0f9d2e5

docs/android.md: Add dependency `libandroid-spawn` for building in termux (#21812)

aafsmarak committed 7 days ago

Verified 0ef6f06d

common/peg : implement ac parser for stricter grammar generation (#24869)

aldehir committed 7 days ago

Verified 52b3df00

server: fix report progress for loading spec models, add "stages" list (#24870)

ngxson committed 8 days ago

Verified 7c082bc4

server: refactor batch construction (#24843)

ngxson committed 8 days ago

Verified bddfd2b1

mtmd: fix mtmd_get_memory_usage (#24867)

ngxson committed 8 days ago

Verified 0d135df4

jinja : implement call statement (#24847)

CISC committed 8 days ago

Verified bf533823

mtmd: add load progress callback (#24865)

ngxson committed 8 days ago

Verified 2f89acc2

server: add "verbose" field to schema (#24864)

ngxson committed 8 days ago

Verified bfa32191

server: real-time model load progress tracking via /models/sse (#24828)

ngxson committed 8 days ago

Verified d6d89958

minor : clean-up whitespaces (#24862)

ggerganov committed 8 days ago

Verified 8a118ee8

spec : Support Step3.5/3.7 flash mtp3 (#24340)

forforever73 committed 8 days ago

Verified d7895274

common/peg : refactor until gbnf grammar generation (#24839)

aldehir committed 8 days ago

Verified 063d9c15

common/json-schema-to-grammar : align spacing rules with parsers (#24835)

aldehir committed 8 days ago

Verified c5760701

fix(hexagon): use padded stride for ssm-conv weights (#24470)

BiReRa committed 8 days ago

Verified 4a809431

llama : use LLM_KV for quantization_version & file_type (#24802)

angt committed 8 days ago

Verified 84de01a1

arg: try fixing test-args-parser randomly fails (#24826)

ngxson committed 9 days ago

Verified 75f460ac

release: add missing link for win opencl adreno arm64 (#24809)

muhammad-salem committed 9 days ago

Verified 84528246

server: avoid forwarding auth headers in CORS proxy (#24373)

ItsMatti4 committed 9 days ago

Verified e27f3085

docker : prebuild web UI for s390x build [no release] (#24829)

aldehir committed 9 days ago

Verified 67e9fd3b

model : glm-dsa load DSA indexer tensors as optional (#24770)

davidrhodus committed 9 days ago

Verified 796f41be

ggml : optimize AMX (#24806)

angt committed 9 days ago

Verified 37a77fb0

convert : more consistent handling of rope_parameters (#24833)

CISC committed 9 days ago

Verified f4043fec

ggml-webgpu: add adapter toggles for F16 on Vulkan + NVIDIA

yomaytk committed 9 days ago

Verified f449e055

server: refactor child --> router communication (#24821)

ngxson committed 9 days ago

Verified 2b686a91

server : optimize get_token_probabilities (#24796)

angt committed 9 days ago

Verified 4b48a53b

mtmd, arg: fix utf8 handling on windows (#24779)

ngxson committed 9 days ago

Verified e475fa2b

Older