llama.cpp
31cecc87 - iq3_s_mult_shuffle: use lookup table on Metal

Commit

1 year ago

iq3_s_mult_shuffle: use lookup table on Metal ~4% faster TG and ~2% faster PP that way.

References

Author

Iwan Kawrakow

Parents