llama.cpp
330c3d2d - vulkan: optimize mul_mat_id loading row ids into shared memory (#15427)

Commit
128 days ago
vulkan: optimize mul_mat_id loading row ids into shared memory (#15427) - Spread the work across the whole workgroup. Using more threads seems to far outweigh the synchronization overhead. - Specialize the code for when the division is by a power of two.
Author
Parents
Loading