transformers
424c0311 - seems like `split_special_tokens` is used here

Commit

2 years ago

seems like `split_special_tokens` is used here

Author

ArthurZucker

ArthurZucker

Committer

Ita Zaporozhets

Parents

Loading