transformers
18349164
- Fix num_hidden_layers in initialization of new model in Mamba (#30403)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Fix num_hidden_layers in initialization of new model in Mamba (#30403) Fix num_hidden_layers in initialization Originally, the initialization was using config.num_layers instead of config.num_hidden_layers. This fixes that.
References
#30403 - Fix num_hidden_layers in initialization of new model in Mamba
Author
SrGonao
Parents
1c2bb3ac
Loading