llama.cpp
metal : extend mat-mat multiplication support
#16225
Open

metal : extend mat-mat multiplication support #16225

ggerganov wants to merge 7 commits into master from gg/metal-mul-mm-extend
ggerganov
github-actions github-actions added ggml
github-actions github-actions added Apple Metal
ggerganov ggerganov force pushed from ea92828e to af284599 1 day ago
github-actions github-actions added testing
ggerganov ggerganov marked this pull request as ready for review 22 hours ago
ggerganov ggerganov requested a review from slaren slaren 22 hours ago
slaren
slaren approved these changes on 2025-09-26
ggerganov metal : support mul_mm with src1->type == GGML_TYPE_F16
c2a96d7d
ggerganov metal : support mul_mm_id with src1->type == GGML_TYPE_F16
6f13728b
ggerganov metal : mul_mm support ne00 % 32 != 0
6e219b76
ggerganov metal : support mul_mm_id with ne00 % 32 != 0
776c5016
ggerganov cont : remove unnecessary unrolls
c1fb380d
ggerganov cont : simplify data loading
989a3484
ggerganov ggerganov force pushed from acac8217 to 989a3484 3 hours ago
ggerganov metal : optimize mul_mm when output bounds checks are not needed
bf47827e

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone