transformers
c4ecd234 - Fix AutoTokenizer when no fast tokenizer is available (#13336)

Commit

4 years ago

Fix AutoTokenizer when no fast tokenizer is available (#13336) * Fix AutoTokenizer when a tokenizer has no fast version * Add test

References

Author

sgugger

Parents