transformers

538b3b46 - [Tokenizer Utils Base] Make pad function more flexible (#9928)

[Tokenizer Utils Base] Make pad function more flexible (#9928) * change tokenizer requirement * split line * Correct typo from list to str * improve style * make other function pretty as well * add comment * correct typo * add new test * pass tests for tok without padding token * Apply suggestions from code review