ggerganov/llama.cpp

Pull Requests Commits

server : print graphs reused in slot timings

ggerganov committed 6 hours ago

Verified e8560c43

ui: Centralize monospace font styles in app.css (#23272)

allozaur committed 6 hours ago

Verified a135ec0b

webui: fix Tailwind v4 utility classes missing when built via cmake (#23253)

zoitrok committed 7 hours ago

Verified 232f4665

llama: initialize pre-norm embedding mask flag (#23256)

abetlen committed 8 hours ago

Verified 49c21f97

add myself to conversion (#23261)

CISC committed 9 hours ago

Verified 77e38d68

ci : added kleidiai-server to server-self-hosted workflow (#22435)

martin-klacer-arm committed 10 hours ago

Verified 053e01df

scripts : allow wc2wt with an existing branch (#23189)

ggerganov committed 13 hours ago

Verified c3f95c1f

sycl: scalar SWAR byte-subtract in Q6_K MMVQ dot product (#22156)

aicss-genai committed 14 hours ago

Verified 0caf2a1d

sycl: route small f32 matmuls to oneMKL, bypass oneDNN (#22150)

aicss-genai committed 14 hours ago

Verified 5511965b

sycl : fix error when use -mg 1 error (#23140)

arthw committed 14 hours ago

Verified e98bcfec

update bid to match each layers MTP source (#23237)

bit-incarnas committed 15 hours ago

Verified 1867a0c6

cmake : do not check for bin install dir (#23234)

CISC committed 19 hours ago

Verified dd7cad71

feat: Support d_conv=15 for ssm-conv.cu (#23017)

gabe-l-hart committed 22 hours ago

Verified 726704a1

cmake : fix LLAMA_BUILD_UI logic (#23190)

aldehir committed 1 day ago

Verified 87589042

cmake : do not install conversion script (#23204)

CISC committed 1 day ago

Verified e0de4c24

CUDA: Continue directly including cuda/iterator (#23102)

ORippler committed 1 day ago

Verified 84c67824

llama: avoid copying logits during prompt decode in MTP (#23198)

am17an committed 1 day ago

Verified 3e12fbde

common : delegate assistant continuation to underlying template handlers (#23089)

aldehir committed 1 day ago

Verified 39cf5d61

ggml-vulkan/CMakeLists: add a check for SPIRV-Headers (#22009)

jeeb committed 1 day ago

Verified a6d6183d

vulkan: add cpy bf16 -> f32 pipelines (#22677)

ServeurpersoCom committed 1 day ago

Verified fcae601e

vulkan: Support unaligned tensors for ROPE (#22637)

jeffbolznv committed 1 day ago

Verified 7ba22c6a

common : enable streaming JSON argument values (#23173)

aldehir committed 1 day ago

Verified f4cc787b

vulkan: fuse SSM_CONV + BIAS + SILU (#22653)

jeffbolznv committed 1 day ago

Verified 3fbadb06

server : honor --embd-normalize CLI arg (#23125)

rvernica committed 1 day ago

Verified 1a68ec93

ngram : reduce noisy logs (#23185)

ddh0 committed 1 day ago

Verified a16cce81

webui: support video files as input (#22830)

foldl committed 1 day ago

Verified 4f13cb74

server: (router) alloc tmp buffer on heap (#23159)

ngxson committed 1 day ago

Verified b64739ea

server: skip device enumeration in router mode to avoid creating CUDA primary context (#23137)

ServeurpersoCom committed 2 days ago

Verified 64b38b56

vulkan: removed duplicate #include <memory> in headers (#23144)

winstonma committed 2 days ago

Verified 60499061

ui: Add request timeout for MCP tool calls (#23138)

allozaur committed 2 days ago

Verified 0253fb21

Older