transformers
2a85345a - Optimize the speed of the truncate_sequences function. (#28263)

Commit
2 years ago
Optimize the speed of the truncate_sequences function. (#28263) * change truncate_sequences * Update tokenization_utils_base.py * change format * fix when ids_to_move=0 * fix * Update src/transformers/tokenization_utils_base.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> --------- Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Author
Parents
Loading