transformers
ae0c27ad
- don't initialize the output embeddings if we're going to tie them to input embeddings (#28192)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
don't initialize the output embeddings if we're going to tie them to input embeddings (#28192) * test that tied output embeddings aren't initialized on load * don't initialize the output embeddings if we're going to tie them to the input embeddings
References
#28192 - don't initialize the output embeddings if we're going to tie them to input embeddings
Author
tom-p-reichel
Parents
a937425e
Loading