transformers
fix: decode() batch path respects self.clean_up_tokenization_spaces
#47793
Merged

fix: decode() batch path respects self.clean_up_tokenization_spaces #47793

lorenzozanee
lorenzozanee lorenzozanee force pushed from 5eee30a7 to c046f254 109 days ago
lorenzozanee lorenzozanee force pushed from c046f254 to 71256f19 109 days ago
lorenzozanee lorenzozanee force pushed from 71256f19 to bd2e9181 108 days ago
lorenzozanee
lorenzozanee lorenzozanee force pushed from e8bbbda8 to c0d15412 108 days ago
lorenzozanee lorenzozanee force pushed from c0d15412 to d6e8ca92 108 days ago
lorenzozanee lorenzozanee force pushed from d6e8ca92 to 06fea321 108 days ago
lorenzozanee
Rocketknight1
itazap
itazap approved these changes on 2026-08-25
HuggingFaceDocBuilderDev
lorenzozanee Fix decode() batch path hardcoding clean_up_tokenization_spaces=False…
46320938
lorenzozanee lorenzozanee force pushed from 5fcd8580 to 46320938 85 days ago
itazap Merge branch 'main' into candidate/tokenizer-processor
338ab4b8
itazap itazap enabled auto-merge 84 days ago
github-actions
github-actions
itazap itazap merged 4ff98bf2 into main 82 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone