Fix bloom add prefix space #25652
properly support Sequence of pretokenizers
17b233ba
actual fix
00138c34
make sure the fix works. Tests are not working for sure!
ae9c0d89
hacky way
96315822
add TODO
6affdd75
update
300a2b38
add a todo
52d2c5fd
nits
8e3cca3a
rename test
4b6b5bd2
nits
ce0824ce
rename test
a7a69a04
Merge branch 'fix-bloom-add-prefix-space' of https://github.com/arthu…
b769fa1c
Merge branch 'main' of https://github.com/huggingface/transformers in…
59d83ee0
ArthurZucker
marked this pull request as ready for review 2 years ago
sgugger
approved these changes
on 2023-08-22
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub