transformers
Fix models for which we don't have a dedicated tokenizer class, and the listed one is incorrect
#45936
Open
Open
Fix models for which we don't have a dedicated tokenizer class, and the listed one is incorrect #45936
itazap
wants to merge
2 commits into
main
from
check_repo_model_tokenizers
we don't check the tokenization of all the model paths we have in the…
96bb162f
fixessss
04207f4d
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub