transformers
b4ba4e1d
- [`RMSNorm`] Fix rms norm init for models that center around 1 (#40796)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
113 days ago
[`RMSNorm`] Fix rms norm init for models that center around 1 (#40796) * fix * fixup inits * oops * fixup gemma * fixup modular order * how does this keep happen lol * vaultgemma is new i forgot * remove init check
References
#40796 - [`RMSNorm`] Fix rms norm init for models that center around 1
Author
vasqu
Parents
fce74651
Loading