transformers
Clarify use of unk_token in slow tokenizers' docstrings
#9875

Merged

Clarify use of unk_token in slow tokenizers' docstrings #9875

LysandreJik merged 1 commit into huggingface:master from ethch18:ethch18/tokenization-unk-docstring

Clarify use of unk_token in tokenizer docstrings

30727d2f

LysandreJik approved these changes on 2021-01-29

LysandreJik merged 99b9affa into master 5 years ago

Reviewers

LysandreJik

Assignees

No one assigned

Labels

None yet

Milestone

No milestone