llama.cpp
dafae66c - vulkan: dynamic subgroup size for the remaining k quants (#10745)

Commit

278 days ago

vulkan: dynamic subgroup size for the remaining k quants (#10745) * q5_k q4_k q3_k q2_k q6_k multi row example * revert as multi row isnt faster for k quants

References

#10745 - vulkan: dynamic subgroup size for the remaining k quants

Author

netrunnereve

Parents

ae4b9226

llama.cpp dafae66c - vulkan: dynamic subgroup size for the remaining k quants (#10745)

llama.cpp
dafae66c - vulkan: dynamic subgroup size for the remaining k quants (#10745)