transformers
126eafe3
- Adding support for BPE merge creation from scores instead of ids. (#22582)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Adding support for BPE merge creation from scores instead of ids. (#22582) * Adding support for BPE merge creation from scores instead of ids. * Revert warn -> raise. * Update src/transformers/convert_slow_tokenizer.py * Quality.
References
#22582 - Adding support for BPE merge creation from scores instead of ids.
Author
Narsil
Parents
12f1a3bb
Loading