transformers
7b0c99ad - Merge pull request #1174 from huggingface/fix_byte_level_added_tokens

Commit
6 years ago
Merge pull request #1174 from huggingface/fix_byte_level_added_tokens Fix byte-level BPE decoding error when using added tokens
Author
Loading