transformers
Let inputs of fast tokenizers be tuples as well as lists
#19898

Merged

Let inputs of fast tokenizers be tuples as well as lists #19898

sgugger merged 3 commits into main from tokenizer_accept_tuple

Let inputs of fast tokenizers be tuples as well as lists

e1369c34

sgugger requested a review from

LysandreJik 3 years ago

LysandreJik approved these changes on 2022-10-27

Update src/transformers/tokenization_utils_fast.py

91ede13b

Style

29cc6b2d

sgugger merged ebfd7229 into main 3 years ago

sgugger deleted the tokenizer_accept_tuple branch 3 years ago

Reviewers

LysandreJik

Assignees

No one assigned

Labels

None yet

Milestone

No milestone