transformers
bb567d85 - refactor can_save_slow_tokenizer (#37722)

Commit
348 days ago
refactor can_save_slow_tokenizer (#37722) * refactor to rm property can_save_slow_tokenizer, it can be done within the if of save_vocab * move property to fast * revert if * check if vocab_file is attr * fix check for sp * fix if condition * fix if condition * fix if condition
Author
Parents
Loading