ggml-org/llama.cpp

Pull Requests Commits

cont : clean-up comments

ggerganov committed 1 day ago

e70959a4

cont : clean-up recurrent memory

ggerganov committed 1 day ago

ca069326

consistent naming + less verbose comments

am17an committed 1 day ago

Verified ed8f16db

remove has_state member, check via ctx_bufs being non-empty

am17an committed 1 day ago

Verified 6880e6d2

Qwen4Exp: add MTP

am17an committed 1 day ago

Verified 6dcd5503

qwen4exp: keep kq_mask input the same shape

am17an committed 1 day ago

Verified f2ef14ea

llama: fix qwen4exp

am17an committed 1 day ago

Verified 56a33d69

mtmd: cap max_image to ubatch for non_causal models (#29773)

ngxson committed 1 day ago

Verified 552f18f9

meta: clear inactive AllReduce shards with FILL, not SCALE (#29793)

ggerganov committed 1 day ago

Verified 5503b04b

jinja : skip copying loop scope unless a loop filter needs it (#29776)

xarillian committed 1 day ago

Verified def4d406

llama-mmap : avoid a second full-size copy of each tensor with direct-io (#29749)

praneshgo committed 2 days ago

Verified 32dd62ee

HIP: avoid treating CDNA as dgx spark for gqa_ratio 20 in fattn_mma dqk 576 (#29572)

IMbackK committed 2 days ago

Verified f11d642a

hex-workqueue: fix race condition in seqn getting out of sync with idx_read/write (#29785)

max-krasnyansky committed 2 days ago

Verified 3aa0ce9b

BLAS : Document AOCL-BLAS build and label the device AOCL-BLAS (#29640)

pradeeptrgit committed 2 days ago

Verified b0aca3c6

common : add LLM-jp-4.1 Harmony dialect handler (#29681)

e-mon committed 2 days ago

Verified b8f96c3e

opencl: mark vec subgroup bcast as supproted for Adreno E17 compiler (#29698)

lhez committed 2 days ago

Verified 3ec4df42

vocab : honor BOS/EOS settings for PLaMo-2 and PLaMo-3 (#29734)

tokinasin committed 2 days ago

Verified db33d3cb

llama-bench : fix verbosity filter to show GGML_LOG_ERROR (#28229)

kushalgarg101 committed 2 days ago

Verified 7dad6db8

metal : use bf16 math for mxfp4 mul-mat (#29770)

ggerganov committed 2 days ago

Verified 2232bc8b

llama-bench : fix docs (#29464)

mairp committed 2 days ago

Verified 79625e05

docs : refresh CPU ops support matrix (#29666)

CaramelizedCUDA committed 2 days ago

Verified 66bcc277

model : re-enable -sm tensor for qwen4exp (#28569)

kh0pper committed 2 days ago

Verified 10f340d1

webgpu: fix SSM_SCAN binding aliasing (#29750)

yomaytk committed 2 days ago

Verified 0c1e5709

ggml-opencl : replace alloca() with std::vector (#29765)

angt committed 2 days ago

Verified f7b384c1

cuda: guard the iq4_nl dequantize row kernel against short rows (#29683)

yeahdongcn committed 2 days ago

Verified f872b591

Hexagon: optimize ALLREDUCE with support for safe scatter mode (#29757)

ebateni committed 2 days ago

Verified a4d880fd

args: fix cli download mmproj arg (#28977)

pr3pony committed 2 days ago

Verified feb9a3d6

llama : preserve original batch order for speculative decoding layer inputs (#29019)

hthadicherla committed 2 days ago

Verified 4453b535

test-llama-archs : toggle causal_attn to catch graph shape changes (#29724)

sihanyu03 committed 2 days ago

Verified 4f31296a

convert : fix LoRA conversion crash for Qwen3.5 V-head reorder (#28324)

Swigler committed 2 days ago

Verified b016f461

Older