transformers
bf7eb0c9 - Remove interdependency from OpenAI tokenizer (#19327)

Commit

3 years ago

Remove interdependency from OpenAI tokenizer (#19327) * Remove interdependency from OpenAI tokenizer * Adjust import order for linter

References

Author

E-Aho

Parents