transformers
[`GemmaConverter`] use user_defined_symbols
#29473
Merged
Overview
Commits
17
Changes
View On GitHub

[`GemmaConverter`] use user_defined_symbols #29473

ArthurZucker merged 17 commits into main from fix-spm-converter
ArthurZucker
ArthurZucker use user_defined_symbols
e7ea676f
HuggingFaceDocBuilderDev
ArthurZucker ArthurZucker requested a review from pcuenca pcuenca 2 years ago
ArthurZucker fixup
2b8461d1
ArthurZucker nit
be547246
pcuenca
pcuenca approved these changes on 2024-03-06
ArthurZucker ArthurZucker marked this pull request as ready for review 2 years ago
ArthurZucker
ArthurZucker add a very robust test
ea4744fc
ArthurZucker make sure all models are tested with the `pretrained_tokenizer_to_test`
0b51d352
ArthurZucker should we make sure we test all of them?
0c023301
ArthurZucker Merge branch 'main' of github.com:huggingface/transformers into fix-s…
c3924e94
ArthurZucker merge
6bae1308
ArthurZucker remove the id
66176758
ArthurZucker fix test
9f174eff
ArthurZucker update
31e8a7c9
LysandreJik
LysandreJik approved these changes on 2024-03-19
ArthurZucker ArthurZucker changed the title [`GemmaConverte`] use user_defined_symbols [`GemmaConverter`] use user_defined_symbols 2 years ago
ArthurZucker ousies
9d0f0c0c
ArthurZucker oups
aa3f2b2e
ArthurZucker fixup
ad794806
ydshieh
ArthurZucker
ArthurZucker fix copies check
13279985
ydshieh
ArthurZucker
ArthurZucker remove `pretrained_tokenizer_to_test`
d1b9bf7f
ArthurZucker Merge branch 'main' of github.com:huggingface/transformers into fix-s…
088c701e
ArthurZucker
ArthurZucker ArthurZucker merged 2f9a3edb into main 2 years ago
ArthurZucker ArthurZucker deleted the fix-spm-converter branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum