llama.cpp
623c1639 - CUDA: HIP: rms_norm: add variants that load float4 at a time and store x in registers (#29720)

Commit
28 days ago
CUDA: HIP: rms_norm: add variants that load float4 at a time and store x in registers (#29720) * CUDA: HIP: rms_norm: load float4 at a time and store x in registers * Add template paramter comments * use ggml_cuda_is_aligned for src * nits * also use ggml_cuda_is_aligned for src in fused variants * fix nits
Author
Parents
Loading