transformers

1e4a7737 - Add support for non-rust implemented tokenization for `__getitem__` method. (#24039)

Add support for non-rust implemented tokenization for `__getitem__` method. (#24039) * Add support for non-rust implemented tokenization for `__getitem__` method. * Update for error message on adding new sub-branch for `__item__` method. --------- Co-authored-by: liuyang17 <liuyang17@zhihu.com>