PR #17241 ggml-cpu: handle 3d tensors in repack mat_mul

ggml-cpu: handle 3d tensors in repack mat_mul #17241

max-krasnyansky merged 7 commits into ggml-org:master from Alcpz:Alcpz/batched_repack_mul_mat

ggml-cpu: handle 3d tensors in repack mul_mat

950671dc

Removed unnecessary branch, removed need for <algorithm>

0b866511

Fixed dst_ptr pointer in chunk + clang_format

75c7fd5d

GGML_ASSERT to check wdata within bounds

edb7f630

Accidental ggml.h inclusion

b56d0ace

Improved GGML_ASSERT on wdata boundaries

d1938adb

Address performance regression in Qwen and llama.cpp due to chunking

c77bafd8

Alcpz changed the title ~~Alcpz/batched repack mul mat~~ ggml-cpu: handle 3d tensors in repack mat_mul 35 days ago

max-krasnyansky marked this pull request as ready for review 35 days ago

max-krasnyansky requested a review from

ggerganov 35 days ago

max-krasnyansky requested a review from

slaren 35 days ago

max-krasnyansky approved these changes on 2025-11-13

github-actions added ggml

max-krasnyansky merged becc4816 into master 35 days ago

Alcpz deleted the Alcpz/batched_repack_mul_mat branch 22 days ago

Reviewers

max-krasnyansky

ggerganov

slaren

Assignees

No one assigned

Labels

ggml

Milestone

No milestone