Fused RMSNorm: multi-row programs and a one-pass backward for narrow norms #8664
yh0903
marked this pull request as ready for review 53 days ago
yh0903
marked this pull request as draft 53 days ago
Give narrow fused RMSNorm rows multi-row programs and a one-pass backā¦
f6a10d11
Test the narrowest RMSNorm block at width 16
8e7b0fd5
Test sub-16 RMSNorm widths against meaningful gradient references
db06f991
Check the first width outside the narrow RMSNorm cutoff
45afc059
yh0903
force pushed
from
3827f935
to
45afc059
36 days ago
yh0903
changed the title Fused RMSNorm: multi-row programs and a one-pass backward for narrow norms (stacked on #8645) Fused RMSNorm: multi-row programs and a one-pass backward for narrow norms 36 days ago
yh0903
marked this pull request as ready for review 36 days ago
Cap narrow RMSNorm tiles to the input row count
bf6b1bf9
tohtana
requested changes
on 2026-10-14
Bound near-zero narrow RMSNorm gradient comparisons
5b540919
Merge branch 'master' into yh0903/fused-rmsnorm-narrow-rows
6191a373
tohtana
approved these changes
on 2026-11-14
Merge branch 'master' into yh0903/fused-rmsnorm-narrow-rows
1e1f77c1
tohtana
merged
7caa7a22
into master 3 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub