transformers
bring back clean_up_tokenization_spaces to tokenizers backend
#43426
Merged
Overview
Commits
2
Changes
View On GitHub

bring back clean_up_tokenization_spaces to tokenizers backend #43426

ArthurZucker merged 2 commits into main from clean_spaces
itazap
github-actions
HuggingFaceDocBuilderDev
ArthurZucker
ArthurZucker approved these changes on 2026-01-23
ArthurZucker
ArthurZucker approved these changes on 2026-01-24
itazap bring back clean_up_tokenization_spaces to tokenizers backend
1d442fc7
itazap test
c992488e
itazap itazap force pushed from 6cf1db84 to c992488e 66 days ago
ArthurZucker ArthurZucker merged 1e8d1297 into main 65 days ago
ArthurZucker ArthurZucker deleted the clean_spaces branch 65 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum