llama.cpp
d08c20ed - [SYCL] Fix the sub group size of Intel (#8106)

Commit
1 year ago
[SYCL] Fix the sub group size of Intel (#8106) * use warp_size macro for all sycl kernels * fix mask of permute_sub_group_by_xor * fix rms_norm with correct warp number * fix rms_norm_f32/group_norm_f32 * move norm to norm.cpp file * fix quantize bug * fix mmvq's batch size
Author
Parents
Loading