transformers
[`RMSNorm`] Fix rms norm init for models that center around 1
#40796
Merged
Overview
Commits
10
Changes
View On GitHub

[`RMSNorm`] Fix rms norm init for models that center around 1 #40796

vasqu merged 10 commits into huggingface:main from vasqu:fix-rms-norm-init
vasqu
vasqu fix
a8c29413
vasqu vasqu requested a review from Cyrilvallez Cyrilvallez 288 days ago
HuggingFaceDocBuilderDev
Cyrilvallez
Cyrilvallez commented on 2025-09-12
vasqu fixup inits
6cdffdf8
vasqu oops
2273e0db
vasqu fixup gemma
9a9afcbe
vasqu fixup modular order
d6ed8bec
vasqu how does this keep happen lol
14ea7497
vasqu
vasqu commented on 2025-09-17
vasqu Merge branch 'main' into fix-rms-norm-init
3cfc9747
vasqu vasqu requested a review from Cyrilvallez Cyrilvallez 281 days ago
vasqu vaultgemma is new i forgot
d3b8c555
Cyrilvallez
Cyrilvallez approved these changes on 2025-09-19
vasqu remove init check
51df3933
github-actions
vasqu Merge branch 'main' into fix-rms-norm-init
5e0efb35
vasqu vasqu enabled auto-merge (squash) 279 days ago
vasqu vasqu merged b4ba4e1d into main 279 days ago
vasqu vasqu deleted the fix-rms-norm-init branch 279 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum