ngxson/llama.cpp

Pull Requests Commits

ci: fix vulkan docker images (#24595)

Kononnable committed 68 days ago

Verified d5376cf5

UI : fix SSE transport detection and routing through CORS proxy. Assi… (#24500)

hrpnr committed 68 days ago

Verified bae36efa

opencl: optimize mul_mat_f16_f32_l4 for decode (#24504)

lhez committed 68 days ago

Verified 51571722

common: update logging to enforce max_capacity and optimize queue resizing (#24490)

max-krasnyansky committed 68 days ago

Verified cda63856

openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (#24503)

wine99 committed 68 days ago

Verified 890f1a27

sycl : Enable to support fp16 by OPs: SQR, SQRT, LOG, SIN, COS, CLAMP (#24692)

arthw committed 68 days ago

Verified 58728bdb

SYCL: fix use-after-free bug with async memcpy in MoE prefill (#24676)

sanmai committed 68 days ago

Verified ebbc1e51

sycl: Add optional USM system allocations (#22526)

ifdu committed 68 days ago

Verified 9b260fc9

vendor : update BoringSSL to 0.20260616.0 (#24693)

cabelo committed 68 days ago

Verified 74ade527

ui: add source toggle to mermaid and svg blocks (#24652)

ServeurpersoCom committed 69 days ago

Verified c1304d7b

Fix and restrict NVFP4 edge-cases in llama-graph (#24331)

ORippler committed 69 days ago

Verified 02810c7a

spec: add backend sampling support for eagle3 (#24655)

ruixiang63 committed 69 days ago

Verified a1824902

vulkan: prefer host-visible memory buffers on UMA devices (#22930)

winstonma committed 69 days ago

Verified 32120c10

vulkan: Support gated_delta_net with S_v=16 (#24581)

jeffbolznv committed 69 days ago

Verified d5fb1042

spec: add spec metrics mean acceptance length and acceptance rate per position (#24536)

ruixiang63 committed 69 days ago

Verified 635b65ad

bench : add --offline (#24511)

angt committed 69 days ago

Verified e3a74b29

sycl: support reordered Q4_K/Q5_K/Q6_K MoE MUL_MAT_ID (#24452)

newjordan committed 69 days ago

Verified ac79caa7

[SYCL] Support OP EXPM1, support all UT cases of FLOOR, TRUNC, ROUND (#24363)

arthw committed 69 days ago

Verified fdd10988

sycl : Make GGML_SYCL_F16=ON the default (#23996)

malsbat committed 69 days ago

Verified 4196b477

vulkan: add col2im_1d op (#24425)

ServeurpersoCom committed 69 days ago

Verified ad39ccaa

chat : fix LFM2 tool-call parsing double-escaping (#24667)

tdakhran committed 69 days ago

Verified 7dad2f1a

mtmd: fix miscounting n_tokens (#24656)

ngxson committed 69 days ago

Verified e36a602b

chat: include full unparsed prompt in debug (#24650)

pwilkin committed 69 days ago

Verified 38d54633

docs: Add instructions to install `llama.cpp` from conda-forge (#22219)

jjerphan committed 69 days ago

Verified a1eb756c

chat: harden peg-native tool call parsing (#24329)

ServeurpersoCom committed 69 days ago

Verified 581e8eca

chat: fix an "oldie but goodie" grammar generator bug that surfaced during last changes (#24653)

pwilkin committed 69 days ago

Verified 0ae3f450

mtmd : add post-decode callback (#24645)

ggerganov committed 69 days ago

Verified e3cab403

vulkan: support more CONCAT types (#24579)

jeffbolznv committed 70 days ago

Verified 9dbc6621

wasm : fix fallback symbol collision (#24639)

abetlen committed 70 days ago

Verified 6eab4718

SYCL: use native subgroup size for K-quant DMMV (#21700)

PMZFX committed 70 days ago

Verified e3bb1add

Newer Older