transformers
Fix T5Tokenizer dropping newlines when vocab contains whitespace tokens
#51064
Open
Go
Login via GitHub
Home
FAQ
Install
Login
via GitHub
Overview
Commits
1
Changes
View On
GitHub
Fix T5Tokenizer dropping newlines when vocab contains whitespace tokens
#51064
AyhamJo7
wants to merge 1 commit into
huggingface:main
from
AyhamJo7:fix/51061-t5-tokenizer-preserve-newlines
Fix T5Tokenizer dropping newlines when vocab contains whitespace tokens
e93244e3
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub