llama.cpp
d67777c2 - metal : add Q8_0 support (#2763)

Commit
1 year ago
metal : add Q8_0 support (#2763) * metal : add dequantize_q8_0 kernel * metal : add mul_mat_q8_0_f32 kernel * metal : add Q8_0 mul_mm kernel
Author
Parents
  • File
    ggml-metal.m
  • ggml-metal.metal