transformers
136cd893
- Always initialize tied output_embeddings if it has a bias term (#28947)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Always initialize tied output_embeddings if it has a bias term (#28947) Continue to initialize tied output_embeddings if it has a bias term The bias term is not tied, and so will need to be initialized accordingly.
References
#28947 - Always initialize tied output_embeddings if it has a bias term
Author
hackyon
Parents
792819f6
Loading