transformers
don't initialize the output embeddings if we're going to tie them to input embeddings
#28192
Merged
Merged
don't initialize the output embeddings if we're going to tie them to input embeddings #28192
ArthurZucker
merged
2 commits into
huggingface:main
from
tom-p-reichel:dont-init-tied-tensors
amyeroberts
approved these changes
on 2024-01-04
ArthurZucker
commented
on 2024-01-05
ArthurZucker
approved these changes
on 2024-01-30
test that tied output embeddings aren't initialized on load
0c0efede
don't initialize the output embeddings if we're going to tie them to …
28fe452b
Login to write a write a comment.
Login via GitHub