ngxson/llama.cpp

Pull Requests Commits

correct default response_format value

ngxson committed 48 days ago

3e59ff3a

address autoreview comments

ngxson committed 49 days ago

94ac891d

server: support OAI /v1/audio/transcriptions API

ngxson committed 49 days ago

aa787b76

vulkan: Flash Attention DP4A shader for quantized KV cache (#20797)

0cc4m committed 49 days ago

Verified 75f3bc94

common : add download cancellation and temp file cleanup (#21813)

angt committed 49 days ago

Verified aa00911d

server: Expose build_info in router mode (#21835)

gaspardpetit committed 49 days ago

Verified ce8fd4b1

CUDA: Limit DeviceSegmentedSort to immediate mode (#21718)

ORippler committed 49 days ago

Verified 9f5e1edb

mtmd: use causal attn for gemma 4 audio (#21824)

ngxson committed 49 days ago

Verified 920b3e78

webui: add setting for first-line chat titles (#21797)

crodjer committed 49 days ago

Verified 974c8c94

webui: MCP Diagnostics improvements (#21803)

allozaur committed 49 days ago

Verified 227ed28e

Remove extra conditional check on debug mode. (#21798)

yomaytk committed 50 days ago

Verified bafae276

sycl: disable Q1_0 in backend and cleanup unused variables (#21807)

qnixsynapse committed 50 days ago

Verified 873c8256

mtmd: fix crash when sending image under 2x2 pixels (#21711)

mzsergiu committed 50 days ago

Verified 82764d8f

mtmd: qwen3 audio support (qwen3-omni and qwen3-asr) (#19441)

ngxson committed 50 days ago

Verified 21a49330

convert : force f16 or f32 on step3-vl conv weights (#21646)

CISC committed 50 days ago

Verified 1e9d771e

mtmd: add gemma 4 test (vision + audio) [no ci] (#21806)

ngxson committed 50 days ago

Verified aa4695c5

mtmd: add Gemma 4 audio conformer encoder support (#21421)

stephencox-ict committed 50 days ago

Verified 547765a9

fix: Proper messages rendering for "Show raw output" (#21672)

allozaur committed 50 days ago

Verified 9e209c5a

docs: add guide on how to add multimodal support (#21778)

ngxson committed 50 days ago

Verified 6313acbe

CUDA: skip compilation of superfluous FA kernels (#21768)

JohannesGaessler committed 51 days ago

Verified ff5ef827

mtmd : add MERaLiON-2 multimodal audio support (#21756)

SiruiHe committed 51 days ago

Verified 073bb2c2

opencl: add basic support for q5_k (#21593)

shaofeiqi committed 51 days ago

Verified af1127d3

TP: fix Qwen 3 Next data split (#21732)

JohannesGaessler committed 51 days ago

Verified 865ff06b

ggml : fix a few instances of missing GGML_TYPE_Q1_0 cases (#21716)

CISC committed 51 days ago

Verified 2b2cd57d

py : Bump typer to latest to fix huggingface_hub issue (#21701)

bartowski1182 committed 51 days ago

Verified 660386f6

CUDA: also store node->src ne/nb for graph equality (#21736)

am17an committed 52 days ago

Verified a29e4c0b

fix: Fix broken structured output when using $refs in json_schema (#21699)

Galunid committed 52 days ago

Verified b136b62c

hexagon: add support for linux on snapdragon (#21707)

tboinovski1 committed 52 days ago

Verified 81069a80

hexagon: improved Op queuing, buffer and cache management (#21705)

max-krasnyansky committed 52 days ago

Verified 9aa28077

common : better align to the updated official gemma4 template (#21704)

aldehir committed 52 days ago

Verified 3fc65063

Older