fix: decode() batch path respects self.clean_up_tokenization_spaces #47793
lorenzozanee
force pushed
from
5eee30a7
to
c046f254
109 days ago
lorenzozanee
force pushed
from
c046f254
to
71256f19
109 days ago
lorenzozanee
force pushed
from
71256f19
to
bd2e9181
108 days ago
lorenzozanee
force pushed
from
e8bbbda8
to
c0d15412
108 days ago
lorenzozanee
force pushed
from
c0d15412
to
d6e8ca92
108 days ago
lorenzozanee
force pushed
from
d6e8ca92
to
06fea321
108 days ago
itazap
approved these changes
on 2026-08-25
Fix decode() batch path hardcoding clean_up_tokenization_spaces=Falseā¦
46320938
lorenzozanee
force pushed
from
5fcd8580
to
46320938
85 days ago
Merge branch 'main' into candidate/tokenizer-processor
338ab4b8
itazap
enabled auto-merge 84 days ago
itazap
merged
4ff98bf2
into main 82 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub