PR #19587 TF port of ESM

TF port of ESM #19587

Rocketknight1 merged 23 commits into main from esm_tf_port

Rocketknight1 requested a review from

gante 3 years ago

Rocketknight1 requested a review from

sgugger 3 years ago

Rocketknight1 force pushed to 7508d138 3 years ago

sgugger approved these changes on 2022-10-14

Partial TF port for ESM model

f77c6fd4

Add ESM-TF tests

8a2449bc

Add the various imports for TF-ESM

ddcb48dd

TF weight conversion almost ready

10cac9f9

Stop ignoring the decoder weights in PT

4f6eff27

Add tests and lots of fixes

9ce1acde

fix-copies

8a89db8a

Fix imports, add model docs

c68f3ef5

Add get_vocab() to tokenizer

f074cd78

Fix vocab links for pretrained files

840df9e9

Allow multiple inputs with a sep

d89bef05

Use EOS as SEP token because ESM vocab lacks SEP

345b3600

Correctly return special tokens mask from ESM tokenizer

c3cc44ff

make fixup

5dbf24c7

Stop testing unsupported embedding resizing

e659a9f9

Handle TF bias correctly

7ebbf2de

Skip all models with slow tokenizers in the token classification test

9f102490

Fixing the batch/unbatcher of pipelines to accomodate the `None` being

357877a7

Fixing pipeline bug caused by slow tokenizer being different.

f5fbfb9f

Rocketknight1 force pushed to f5fbfb9f 3 years ago

gante approved these changes on 2022-10-14

Update src/transformers/models/esm/modeling_tf_esm.py

7f85040c

Update src/transformers/models/esm/modeling_tf_esm.py

82d39c18

Update src/transformers/models/esm/modeling_tf_esm.py

068374fd

Update set_input_embeddings and the copyright notices

ca2a52fa

Rocketknight1 merged 3b3024da into main 3 years ago

Rocketknight1 deleted the esm_tf_port branch 3 years ago

Reviewers

gante

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers TF port of ESM #19587 Merged

TF port of ESM #19587

transformers
TF port of ESM
#19587

Merged