llama.cpp
CUDA: HIP: rms_norm: add variants that load float4 at a time and store x in registers
#29720
Merged
Merged
CUDA: HIP: rms_norm: add variants that load float4 at a time and store x in registers #29720
ggerganov
merged
6 commits into
ggml-org:master
from
IMbackK:rms_norm_opt
am17an
commented
on 2026-09-30
am17an
approved these changes
on 2026-09-30
CUDA: HIP: rms_norm: load float4 at a time and store x in registers
75efe475
Add template paramter comments
e9b79956
use ggml_cuda_is_aligned for src
ba9f35dd
nits
e8b5af39
am17an
approved these changes
on 2026-10-14
also use ggml_cuda_is_aligned for src in fused variants
06c240bd
fix nits
1599e410
Login to write a write a comment.
Login via GitHub