transformers
Add Maximal Update Parametrization (μP)
#45848
Open
Overview
Commits
7
Changes
View On GitHub

Add Maximal Update Parametrization (μP) #45848

qgallouedec wants to merge 7 commits into main from mup
qgallouedec
qgallouedec Maximal Update Parametrization
6fde9cbd
qgallouedec trainer integration
9a8dea16
HuggingFaceDocBuilderDev
qgallouedec qgallouedec requested a review from Rocketknight1 Rocketknight1 48 days ago
qgallouedec qgallouedec requested a review from SunMarc SunMarc 48 days ago
qgallouedec style
a71f5f6d
qgallouedec simplify
b3bf576f
qgallouedec Merge branch 'main' into mup
3289ae13
qgallouedec Merge branch 'main' into mup
99224d05
qgallouedec Merge branch 'main' into mup
da8150f9
github-actions

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum