transformers
Fix the init_weights for the MoE models
#42306
Merged

Fix the init_weights for the MoE models #42306

Cyrilvallez merged 4 commits into main from init-moes
Cyrilvallez
Cyrilvallez fix the modulars
efedbc34
Cyrilvallez apply modulars
8484f3b5
Cyrilvallez forgot jamba
1b871b2e
github-actions
Cyrilvallez fix doc
b2dad1fc
HuggingFaceDocBuilderDev
Cyrilvallez Cyrilvallez merged 26785ae9 into main 203 days ago
Cyrilvallez Cyrilvallez deleted the init-moes branch 203 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone