ggml-org/llama.cpp

Pull Requests Commits

fix plamo2 attention_key/value_length regression

CISC committed 12 hours ago

Verified 502f0d15

server : do not parse when flushing http headers (#24281)

aldehir committed 13 hours ago

Verified 42a0afd5

graph: guard iswa kq_mask on its own buffer (#24294)

ServeurpersoCom committed 14 hours ago

Verified a66d5058

[ggml-webgpu] Handle buffer overlap / buffer aliasing for concat operator (#24000)

nikhilJain17 committed 16 hours ago

Verified 1705d434

[ggml-webgpu] Implement 2D workgroups for scale, binary, and unary ops (#24044)

nikhilJain17 committed 16 hours ago

Verified 3b3da01d

docker: install ffmpeg in the released image (#24302)

ngxson committed 16 hours ago

Verified 3ebe862b

mtmd : add video input support (#24269)

ngxson committed 20 hours ago

Verified 8f83d6c2

ggerganov committed 20 hours ago

c2b1518f

ggml : bump version to 0.14.0 (ggml/1533)

ggerganov committed 20 hours ago

6a1de6fb

cli: fix spinner not show during prompt processing (#24283)

ngxson committed 22 hours ago

Verified 715b86a3

vulkan: Use cm2 decode_vector for mul_mat_id B matrix loads (#23991)

jeffbolznv committed 23 hours ago

Verified c74759a2

cuda: reset cuda context after reading memory size (#23935)

0cc4m committed 23 hours ago

Verified 0f7fada5

HIP: add gfx1152 and gfx1153 to RDNA3.5 (#24129)

harkgill-amd committed 1 day ago

Verified 19bba67c

metal : fix im2col 1D case (audio models) (#24220)

ngxson committed 1 day ago

Verified daf6bc9f

[SYCL] Update compute runtime version to 26.x in docker (#24070)

arthw committed 1 day ago

Verified d403f00e

common : relax sampler name matching (#23744)

ddh0 committed 1 day ago

Verified 9e3b928f

convert : fix conversion for Mistral-Medium-3.5-128B (#24268)

dfriehs committed 1 day ago

Verified 8a963fc1

kv-cache : avoid kv cells copies (#24277)

ggerganov committed 1 day ago

Verified 379ac667

kv-cache: follow the source cache size when sharing cells (#24267)

ServeurpersoCom committed 1 day ago

Verified f0156d14

llama : add Gemma4 MTP (#23398)

am17an committed 1 day ago

Verified 04eb4c44

spec : fix vocab compatibility check (#24256)

CISC committed 1 day ago

Verified 8a091c47

arg: Skip mmproj download when user supplied mmproj (#24239)

konradmb committed 1 day ago

Verified 465b1f0e

convert : fix Gemma4 with no audio encoder (#24242)

CISC committed 2 days ago

Verified f71af352

docker : bump cuda13 to 13.3.0 (#24228)

CISC committed 2 days ago

Verified 3f7c79d7

common/chat : fix LFM2/LFM2.5 reasoning round-trip and <think> leak (#24234)

tdakhran committed 2 days ago

Verified 98d5e8ba

mtmd: support "frame merge" for qwen-vl-based models (#21858)

ngxson committed 2 days ago

Verified 31e82494

completion : remove useless statics (#24226)

angt committed 2 days ago

Verified 6b80c74f

completion : fix format specifier in LOG_INF (#24213)

angt committed 2 days ago

Verified 588f0dc2

mtmd, server: add "placeholder bitmap" for counting tokens , add */input_tokens API (#23913)

ngxson committed 2 days ago

Verified f5c6ae18

vulkan: check coopmat2 features before reporting support (#24186)

0cc4m committed 3 days ago

Verified 5a69c974

Older