transformers
[GPT2Tokenizer] Raise ValueError for Fast GPT2Tokenizer with bos token for now
#17498
Merged

[GPT2Tokenizer] Raise ValueError for Fast GPT2Tokenizer with bos token for now #17498

patrickvonplaten
patrickvonplaten [GPT2Tokenizer] Fix GPT2 with bos token
2acf940c
patrickvonplaten patrickvonplaten requested a review from sgugger sgugger 4 years ago
patrickvonplaten
patrickvonplaten commented on 2022-05-31
patrickvonplaten
HuggingFaceDocBuilderDev
patrickvonplaten patrickvonplaten changed the title [GPT2Tokenizer] Fix GPT2 with bos token [GPT2Tokenizer] Raise ValueError for Fast GPT2Tokenizer with bos token for now 4 years ago
sgugger
sgugger approved these changes on 2022-05-31
SaulLu
patrickvonplaten patrickvonplaten merged ba286fe7 into main 4 years ago
patrickvonplaten patrickvonplaten deleted the raise_incorrect_gpt2_behavior branch 4 years ago
LysandreJik
dhansmair
patrickvonplaten
Narsil

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone