llama.cpp
28e6146c
- iq2_xs: attempt to fix AVX dot product for QK_K = 64
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
iq2_xs: attempt to fix AVX dot product for QK_K = 64 Tests pass, but I get gibberish.
References
#5760 - Make i-quants work with super-blocks of 64 (CPU and Metal)
Author
Iwan Kawrakow
Parents
13ba37f1
Loading