PR #20424 Make `add_special_tokens` more clear

Make `add_special_tokens` more clear #20424

ydshieh merged 5 commits into main from break_all_and_fix

ydshieh commented on 2022-11-24

ydshieh requested a review from

sgugger 3 years ago

ydshieh requested a review from

SaulLu 3 years ago

sgugger approved these changes on 2022-11-28

break 1

baa98ce5

break 2

85273fa8

break 3

5a997930

break 4

3465e09f

ydshieh force pushed from 0d8bc068 to 3465e09f 3 years ago

fix style

d7528df8

ydshieh merged 293991d4 into main 3 years ago

ydshieh deleted the break_all_and_fix branch 3 years ago

ydshieh changed the title ~~fix tokenization~~ Make `add_special_tokens` more clear 3 years ago

Reviewers

sgugger

SaulLu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone