Fix flax whisper tokenizer bug #33151
amyeroberts
merged
16 commits into
huggingface:main
from
hannan72:fix_flax_whisper_tokenizer_bug
Update tokenization_whisper.py
d7f393d6
Update tokenization_whisper_fast.py
624c9816
amyeroberts
commented
on 2024-08-27
Update tokenization_whisper.py
7f5b42c9
Update tokenization_whisper_fast.py
d41a4403
Update tokenization_whisper_fast.py and revert changes in _strip_prom…
44e6f1f8
Update tokenization_whisper.py and revert changes in _strip_prompt an…
0cd19d3a
Update test_tokenization_whisper.py to add test for _convert_to_list …
6ba66e63
Update test_tokenization_whisper.py to fix code style issues
f05078c1
Fix code style
969be37d
Fix code check again
64093a6d
Update test_tokenization)whisper.py to Improve code style
fa1c3b0f
Update test_tokenization_whisper.py to run each of jax, tf and flax m…
ce9cd4fb
amyeroberts
commented
on 2024-09-05
Update tests/models/whisper/test_tokenization_whisper.py
00b2190a
Update test_tokenization_whisper.py and use require_xxx decorators in…
afcd3a27
amyeroberts
commented
on 2024-09-09
Revert the changes automatically applied by formatter and was unrelat…
a0cd5d94
Format for minimal changes
27752779
amyeroberts
approved these changes
on 2024-09-12
Login to write a write a comment.
Login via GitHub