ggml-org/llama.cpp

Pull Requests Commits

cont : rm asserts

ggerganov committed 1 hour ago

Verified a115953e

server : adjust checkpoint logic

ggerganov committed 2 hours ago

Verified 3f7fdaaa

review: rename, add asserts

am17an committed 4 hours ago

a8a33f63

review: deslop comments

am17an committed 4 hours ago

66e47d13

review: rename part_bounded to n_rs

am17an committed 4 hours ago

7cb69f5f

review: add need_rs_seq

am17an committed 4 hours ago

757be51e

delta_net_base: use ggml_pad instead of new_tensor

am17an committed 5 hours ago

b9c2a4f2

metal: add GDN partial rollback

ggerganov committed 5 hours ago

1bd883d5

meta: extend check to axis 1

am17an committed 6 hours ago

a25be1b9

vulkan: add GDN partial rollback

am17an committed 7 hours ago

8c059236

fix pending state

am17an committed 7 hours ago

9a3a4872

llama: allow partial seq_rm for GDN models for speculative decoding

am17an committed 10 hours ago

4e732e0a

add need_embd in speculative

am17an committed 1 day ago

e7b48481

remove unused llama_arch

am17an committed 1 day ago

19dd00b0

mtp -> draft-mtp

am17an committed 1 day ago

f2200a3a

MTP: clean-up (#9)

am17an committed 1 day ago

3c3aebaa

cont : simplify (#7)

ggerganov committed 1 day ago

5c58cc5b

am17an committed 1 day ago

180f8ff3

am17an committed 1 day ago

edcaf120

spec: support MTP

am17an committed 1 day ago

a55493bb

spec : update CLI arguments for better consistency (#22964)

ggerganov committed 1 day ago

Verified 634275fb

llama-eval : enable type check (#22988)

CISC committed 1 day ago

Verified bcfe63fc

ggml-zendnn : adaptive fallback to CPU backend for small batch sizes (#22681)

z-sachin committed 1 day ago

Verified 61af07c2

hexagon: eliminate scalar VTCM loads via HVX splat helpers (#22993)

trivikram-reddy1 committed 1 day ago

Verified 856c3ada

opencl: add opt-in Adreno xmem F16xF32 GEMM for prefill (#22755)

happyyzy committed 1 day ago

Verified a9883db8

convert : fix Pixtral 12B --mistral-format conversion (3 bugs) (#22981)

fredzillman committed 1 day ago

Verified cce09f0b

webui: Fix Chat Screen Form box disappearing + autoscroll issues on WebKit (#22977)

allozaur committed 1 day ago

Verified dded58b4

mtmd, server, common: expose modalities to /v1/models (#22952)

ngxson committed 1 day ago

Verified 7bfe120c

ggml-webgpu: Enables running gpt-oss-20b (#22906)

yomaytk committed 1 day ago

Verified 927dada6

ggml-webgpu: address precision issues for multimodal (#22808)

Constannnnnt committed 1 day ago

Verified 239a497e

Older