ggml-org/llama.cpp

Pull Requests Commits

Converge implementation with export-graph-ops

pwilkin committed 1 day ago

f0210cc4

Add missing op parameters to the profiler; add support for test-backend-ops to run performance tests with exactly the tensor shapes from the run

pwilkin committed 1 day ago

2bbcc61a

docs, pass copy details

pwilkin committed 1 day ago

ff5d0bbc

fix mul_mat_id stats, add throughput stat, add envvar trigger, add concurrent mode fix

pwilkin committed 1 day ago

395c43ea

fix builds, integrate vulkan profiler, fix copy events, fix export

pwilkin committed 1 day ago

b1252bcd

Fix more missing backend stuff (and Python errors)

pwilkin committed 1 day ago

8291ecd7

add second dimension to reported tensors, fix Mac build, add missing initializer to all backends

pwilkin committed 1 day ago

391d2bf2

feat: cool profiler thingy

pwilkin committed 1 day ago

2e66d2c1

model : add sarvam_moe architecture support (#20275)

sumitchatterjee13 committed 1 day ago

Verified 1e5ad35d

devops : updated Nix systems (#22869)

yuannan committed 1 day ago

Verified 65d7a8bb

docker : upgraded the default intel compute-runtime version (#22567)

WizardlyBump17 committed 1 day ago

Verified 00d56b11

cmake : update BoringSSL to 0.20260508.0 (#22839)

cabelo committed 1 day ago

Verified 5757c4dc

SYCL: reduce allocation overhead during flash attention (#22732)

sanmai committed 1 day ago

Verified e20b8393

[SYCL] Add BF16 support to GET_ROWS operation (#21391)

devedse committed 1 day ago

Verified fd895565

sycl: Q5_K reorder MMVQ/dequant + Q8_0 reorder MMVQ path (#22152)

aicss-genai committed 1 day ago

Verified 60489932

sycl: Battlemage AOT build via spir64_gen + MMQ subgroup annotations (#22147)

aicss-genai committed 1 day ago

Verified 4a4f819c

Add flash attention MMA / Tiles to support MiMo-V2.5 (#22812)

AesSedai committed 1 day ago

Verified 046e2844

hexagon: add HTP kernel for GGML_OP_GATED_DELTA_NET (#22837)

wyanzhao committed 2 days ago

Verified 66001722

sycl: support non-contiguous input in PAD op (#22148)

aicss-genai committed 2 days ago

Verified c5703e03

Feature hexagon l2 norm (#22816)

pdhinaka committed 2 days ago

Verified b46812de

common : do not wrap raw strings in schema parser for tagged parsers (#22827)

aldehir committed 2 days ago

Verified 49956041

model : support Gemma4_26B_A4B_NVFP4 (#22804)

ynankani committed 2 days ago

Verified 9f5f0e68

common : revert reasoning budget +inf logit bias (#22740)

aldehir committed 2 days ago

Verified f9cd456e

webui: fix LLM title generation for agentic conversations (#22840)

smugman-dot committed 2 days ago

Verified 5d6f18a6

server: support Vertex AI compatible API (#22545)

ngxson committed 2 days ago

Verified 29debb3a

server: (router) expose child model info from router's /v1/models (#22683)

ngxson committed 2 days ago

Verified 9dcf8355

cuda: fuse snake activation (mul, sin, sqr, mul, add) (#22667)

ServeurpersoCom committed 2 days ago

Verified 58e68df0

webui: Add Import/Export of Settings configuration + improve architecture (#22803)

allozaur committed 2 days ago

Verified 9b2925e1

CUDA: lower-case PCI bus id, standardize for ggml (#22820)

JohannesGaessler committed 2 days ago

Verified a8fd165f

vulkan: fix spv shadowing (#22760)

miyanyan committed 2 days ago

Verified 6d57a49a

Older