WIP: make i-quants work for QK_K = 64 - SemanticDiff

Commit

1 year ago

WIP: make i-quants work for QK_K = 64

References

#5760 - Make i-quants work with super-blocks of 64 (CPU and Metal)

Author

Iwan Kawrakow

Parents

Loading