llama.cpp
metal : extend mat-mat multiplication support
#16225
Merged

metal : extend mat-mat multiplication support #16225

ggerganov merged 7 commits into master from gg/metal-mul-mm-extend
ggerganov
github-actions github-actions added ggml
github-actions github-actions added Apple Metal
ggerganov ggerganov force pushed from ea92828e to af284599 84 days ago
github-actions github-actions added testing
ggerganov ggerganov marked this pull request as ready for review 83 days ago
ggerganov ggerganov requested a review from slaren slaren 83 days ago
slaren
slaren approved these changes on 2025-09-26
ggerganov metal : support mul_mm with src1->type == GGML_TYPE_F16
c2a96d7d
ggerganov metal : support mul_mm_id with src1->type == GGML_TYPE_F16
6f13728b
ggerganov metal : mul_mm support ne00 % 32 != 0
6e219b76
ggerganov metal : support mul_mm_id with ne00 % 32 != 0
776c5016
ggerganov cont : remove unnecessary unrolls
c1fb380d
ggerganov cont : simplify data loading
989a3484
ggerganov ggerganov force pushed to 989a3484 83 days ago
ggerganov metal : optimize mul_mm when output bounds checks are not needed
bf47827e
ggerganov ggerganov merged 6a2c6145 into master 82 days ago
ggerganov ggerganov deleted the gg/metal-mul-mm-extend branch 82 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone