transformers
f9257843 - Fix incorrect model<->tokenizer mapping in tokenization testing (#19872)

Commit

3 years ago

Fix incorrect model<->tokenizer mapping in tokenization testing (#19872) * Fix model-tokenizer mapping Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

References

#19872 - Fix somehow incorrect model - tokenizer mapping in tokenization testing

Author

ydshieh

Parents

eedaba68

transformers f9257843 - Fix incorrect model<->tokenizer mapping in tokenization testing (#19872)

transformers
f9257843 - Fix incorrect model<->tokenizer mapping in tokenization testing (#19872)