transformers
[GPT2Tokenizer] Raise ValueError for Fast GPT2Tokenizer with bos token for now
#17498
Merged
Overview
Commits
1
Changes
View On GitHub

[GPT2Tokenizer] Raise ValueError for Fast GPT2Tokenizer with bos token for now #17498

patrickvonplaten merged 1 commit into huggingface:main from patrickvonplaten:raise_incorrect_gpt2_behavior
patrickvonplaten
patrickvonplaten [GPT2Tokenizer] Fix GPT2 with bos token
2acf940c
patrickvonplaten patrickvonplaten requested a review from sgugger sgugger 4 years ago
patrickvonplaten
patrickvonplaten commented on 2022-05-31
patrickvonplaten
HuggingFaceDocBuilderDev
patrickvonplaten patrickvonplaten changed the title [GPT2Tokenizer] Fix GPT2 with bos token [GPT2Tokenizer] Raise ValueError for Fast GPT2Tokenizer with bos token for now 4 years ago
sgugger
sgugger approved these changes on 2022-05-31
SaulLu
patrickvonplaten patrickvonplaten merged ba286fe7 into main 4 years ago
patrickvonplaten patrickvonplaten deleted the raise_incorrect_gpt2_behavior branch 4 years ago
LysandreJik
dhansmair
patrickvonplaten
Narsil

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum