llama.cpp
064cdc26
- vulkan : fix Qantized Mat-Vec Mul on AMD GPUs for ncols < 64 (#8855)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
vulkan : fix Qantized Mat-Vec Mul on AMD GPUs for ncols < 64 (#8855) * Fix Vulkan mul mat vec invalid results when ncols < warp size * Only run backend ops mul mat vec block size test if block size not already covered
References
#8855 - Fix Vulkan Quantized Matrix Vector Multiplication on AMD GPUs when ncols < 64
Author
0cc4m
Parents
5587e57a
Loading