ggerganov/llama.cpp

Pull Requests Commits

arthw committed 101 days ago

2985be33

enhance FA stable in UT

arthw committed 114 days ago

8dc96153

[SYCL] ehance UPSCALE to support all UT cases (#20637)

arthw committed 115 days ago

Verified b6c83aad

tools/server: support refusal content for Responses API (#20285)

pwilkin committed 115 days ago

Verified 2e4a6edd

model: mistral small 4 support (#20649)

ngxson committed 115 days ago

Verified d34ff7eb

ci : disable AMX jobs (#20654)

ggerganov committed 115 days ago

Verified 45172df4

benches : add Nemotron 3 Nano on DGX Spark (#20652)

ggerganov committed 115 days ago

Verified 9b342d0a

tests : write to binary buffer to avoid newline translation in jinja -py [no ci] (#20365)

CISC committed 115 days ago

Verified 55e87026

kleidiai: add data type check to get_tensor_traits (#20639)

martin-klacer-arm committed 115 days ago

Verified cf21cdf3

ci : update labeler (#20629)

CISC committed 115 days ago

Verified 0ed99297

jinja : add capability check for object args (#20612)

aldehir committed 115 days ago

Verified 1bbec6a7

ggerganov committed 115 days ago

f47a246a

ggml : try fix arm build (whisper/0)

ggerganov committed 115 days ago

c0ccbd1f

ggml : extend im2col f16 (ggml/1434)

David366AI committed 115 days ago

f6da02c3

webui: add model information dialog to router mode (#20600)

ServeurpersoCom committed 115 days ago

Verified dddca026

llama-graph: replace cont with reshape for alpha in qwen35 (#20640)

am17an committed 115 days ago

Verified 3c8521c4

webui: Add MCP CORS Proxy detection logic & UI (#20167)

allozaur committed 115 days ago

Verified 67a2209f

Fix model selector locked to first loaded model with multiple models (#20580)

ServeurpersoCom committed 115 days ago

Verified d65c4f2d

webui: use date in more human readable exported filename (#19939)

woof-dog committed 115 days ago

Verified d8c331c0

vulkan: fix flash attention dot product precision (#20589)

0cc4m committed 115 days ago

Verified 46dba9fc

model : wire up Nemotron-H tensors for NVFP4 support (#20561)

CISC committed 115 days ago

Verified de8f01c2

convert : support mixed-precision ModelOpt models with per-tensor NVFP4/FP8 quantization (#20539)

richarddd committed 115 days ago

Verified 079e5a45

common : fix iterator::end() dereference (#20445)

rillomas committed 115 days ago

Verified d3936498

CUDA: GDN hide memory latency (#20537)

am17an committed 116 days ago

Verified 34818ea6

tools/cli: fix disable reasoning (#20606)

pwilkin committed 116 days ago

Verified 9e2e2198

server : fix wait in test_cancel_requests() test (#20601)

ggerganov committed 116 days ago

Verified 88915cb5

sycl : fix for untransposed GDA recurrent state (#20583)

CISC committed 116 days ago

Verified ebbf544e

ci : only save openvino caches on github-hosted master (#20593)

CISC committed 116 days ago

Verified b91d7dfe

CUDA: limit number of FA stream-k CUDA blocks (#20586)

JohannesGaessler committed 116 days ago

Verified ae40cd27

ggml: avoid creating CUDA context during device init (#20595)

ServeurpersoCom committed 116 days ago

Verified ceef6b52

Older