transformers
df160af7
- :bug: #2096 in tokenizer.decode, space is not joined between all subtexts instead of before added tokens
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
6 years ago
:bug: #2096 in tokenizer.decode, space is not joined between all subtexts instead of before added tokens
References
#2101 - :bug: #2096 in tokenizer.decode, adds a space after special tokens for string format
Author
Pascal Voitot
Committer
LysandreJik
Parents
5b7b78e0
Loading