PR #24205 Fix Debertav2 embed_proj

Fix Debertav2 embed_proj #24205

amyeroberts merged 14 commits into huggingface:main from WissamAntoun:debertav2_embed_project

MLM prediction head output size from embed_size

c306ece9

project TFDebertaV2 mlm output to embedding size

0381e146

fix the same issue for reshaping after projection

b0981f20

fix layernorm size

6e834629

add self.embedding_size to scope

b63eb226

fix embed_proj scope name

e23f7e18

apply the same changes to TF Deberta

6f9b3e62

add the changes to deberta

282e2149

added self.embedding_size instead of config.embedding_size

57d93d70

added the same change to debertav2

7ff280cb

added coppied from deberta to deberta2 model

7e8d32b6

config.embedding_size fix

92b6f793

black

1c781e44

fix deberta config name

c6cac456

gante approved these changes on 2023-06-13

gante requested a review from

amyeroberts 2 years ago

amyeroberts approved these changes on 2023-06-14

amyeroberts merged 860d11ff into main 2 years ago

Reviewers

amyeroberts

gante

Assignees

No one assigned

Labels

None yet

Milestone

No milestone