llama.cpp
6a2c6145 - metal : extend mat-mat multiplication support (#16225)

Commit
77 days ago
metal : extend mat-mat multiplication support (#16225) * metal : support mul_mm with src1->type == GGML_TYPE_F16 * metal : support mul_mm_id with src1->type == GGML_TYPE_F16 [no ci] * metal : mul_mm support ne00 % 32 != 0 * metal : support mul_mm_id with ne00 % 32 != 0 * cont : remove unnecessary unrolls * cont : simplify data loading * metal : optimize mul_mm when output bounds checks are not needed
Author
Parents
Loading