transformers
e3a4bd2b
- add custom RMSNorm to `ALL_LAYERNORM_LAYERS` (#26227)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
add custom RMSNorm to `ALL_LAYERNORM_LAYERS` (#26227) * add LlamaRMSNorm to ALL_LAYERNORM_LAYERS * fixup * add IdeficsRMSNorm to ALL_LAYERNORM_LAYERS and fixup
References
#26227 - add custom RMSNorm to `ALL_LAYERNORM_LAYERS`
Author
shijie-wu
Parents
0b5024ce
Loading