llama.cpp
a91a4136 - vulkan: optimize coopmat2 dequant functions (#10855)

Commit
1 year ago
vulkan: optimize coopmat2 dequant functions (#10855) Change the code to do 16b loads when possible and extract the appropriate component late, so the code is effectively decoding a pair of elements and then selecting one. This can allow more commoning to happen in the compiler when neighboring elements are loaded.
Author
Parents
Loading