transformers
17ade127 - Exposing prepare_for_model for both slow & fast tokenizers (#5479)

Commit
5 years ago
Exposing prepare_for_model for both slow & fast tokenizers (#5479) * Exposing prepare_for_model for both slow & fast tokenizers * Update method signature * The traditional style commit * Hide the warnings behind the verbose flag * update default truncation strategy and prepare_for_model * fix tests and prepare_for_models methods Co-authored-by: Thomas Wolf <thomwolf@users.noreply.github.com>
Author
Parents
Loading