llama.cpp
803dac2e - vulkan: use vec dot for matrix matrix multiplications (#16056)

Commit
4 days ago
vulkan: use vec dot for matrix matrix multiplications (#16056) * vulkan: Change the mul_mm shared memory and register caching system to use vec2 instead of scalars, to enable using dot2 instructions * use fma instead of dot to fix Nvidia and Apple performance issues
Author
Parents
Loading