transformers
e3a4bd2b - add custom RMSNorm to `ALL_LAYERNORM_LAYERS` (#26227)

Commit

2 years ago

add custom RMSNorm to `ALL_LAYERNORM_LAYERS` (#26227) * add LlamaRMSNorm to ALL_LAYERNORM_LAYERS * fixup * add IdeficsRMSNorm to ALL_LAYERNORM_LAYERS and fixup

References

Author

shijie-wu

Parents

transformers e3a4bd2b - add custom RMSNorm to `ALL_LAYERNORM_LAYERS` (#26227)

transformers
e3a4bd2b - add custom RMSNorm to `ALL_LAYERNORM_LAYERS` (#26227)