llama.cpp
af1127d3 - opencl: add basic support for q5_k (#21593)

Commit
4 days ago
opencl: add basic support for q5_k (#21593) * opencl: add general q5_k mv * opencl: add flattened Q5_K mv and general Q5_K mm * opencl: fix Q5_K unit tests
Author
Parents
Loading