llama.cpp
77f132cb - vulkan: Change mul_mat_id to pad K rather than N (#27925)

Commit
62 days ago
vulkan: Change mul_mat_id to pad K rather than N (#27925) The N padding is needed for mul_mat, but not mul_mat_id. For mul_mat_id, we indirect the row index through a shared memory lookup table which avoids any OOB row coordinate. But that callback doesn't bounds check K, so we actually need K padding instead.
Author
Parents
Loading