llama.cpp
vulkan: use vec dot for matrix matrix multiplications
#16056

Merged

vulkan: use vec dot for matrix matrix multiplications #16056

0cc4m merged 2 commits into master from 0cc4m/vulkan-mm-use-vec-dot

vulkan: Change the mul_mm shared memory and register caching system t…

be5a0a8b

0cc4m requested a review from

jeffbolznv 274 days ago

github-actions added Vulkan

github-actions added ggml

jeffbolznv approved these changes on 2025-09-18

0cc4m marked this pull request as draft 273 days ago

use fma instead of dot to fix Nvidia and Apple performance issues

e604b63d

0cc4m marked this pull request as ready for review 272 days ago

0cc4m requested a review from

jeffbolznv 272 days ago

jeffbolznv approved these changes on 2025-09-19

netrunnereve approved these changes on 2025-09-19

0cc4m merged 803dac2e into master 271 days ago

0cc4m deleted the 0cc4m/vulkan-mm-use-vec-dot branch 271 days ago

Reviewers

netrunnereve

jeffbolznv

Assignees

No one assigned

Labels

Vulkan ggml

Milestone

No milestone