transformers
Fix #16660 (tokenizers setters of ids of special tokens)
#16661

Merged

Fix #16660 (tokenizers setters of ids of special tokens) #16661

sgugger merged 6 commits into huggingface:main from davidleonfdez:fix-set-tokens-ids

Fix setters of *_token_id properties of SpecialTokensMixin

3b749f06

Test setters of common tokens ids

e8f34ab6

Move to a separate test checks of setters of tokens ids

288d5c1e

SaulLu commented on 2022-04-11

Add independent test for ByT5

82ca333d

Add Canine test

16410d81

Test speech to text

e3a1fc87

SaulLu approved these changes on 2022-04-13

SaulLu requested a review from

sgugger 4 years ago

SaulLu requested a review from

LysandreJik 4 years ago

SaulLu requested a review from

patil-suraj 4 years ago

SaulLu requested a review from

patrickvonplaten 4 years ago

sgugger approved these changes on 2022-04-13

sgugger merged 9f8bfe70 into main 4 years ago

patil-suraj approved these changes on 2022-04-13

Reviewers

SaulLu

patil-suraj

sgugger

LysandreJik

patrickvonplaten

Assignees

No one assigned

Labels

None yet

Milestone

No milestone