transformers
126eafe3 - Adding support for BPE merge creation from scores instead of ids. (#22582)

Commit
2 years ago
Adding support for BPE merge creation from scores instead of ids. (#22582) * Adding support for BPE merge creation from scores instead of ids. * Revert warn -> raise. * Update src/transformers/convert_slow_tokenizer.py * Quality.
Author
Parents
Loading