transformers
00132b7a - updating docs - adding few tests to tokenizers

Commit

6 years ago

updating docs - adding few tests to tokenizers

References

#910 - Adding AutoTokenizer and AutoModel classes that automatically detect architecture - Clean up tokenizers

Author

thomwolf

thomwolf

Parents

Loading