[Whisper] Fix whisper tokenizer (#34537)
* handle single timestamp ending
* include last timestamp token
* handle single timestamp ending
* avoid floating points arithm limitations
* ensure float64 operations
* new test
* make fixup
* make copies
* handle edge case double tokens ending with different tokens
* handle single timestamp ending
* make fixup
* handle conditioning on prev segments
* fix
* Update src/transformers/models/whisper/generation_whisper.py
Co-authored-by: Yoach Lacombe <52246514+ylacombe@users.noreply.github.com>
* [run-slow] whisper
* don't call item() to avoid unnecessary sync
* fix
---------
Co-authored-by: Yoach Lacombe <52246514+ylacombe@users.noreply.github.com>
Co-authored-by: Eustache Le Bihan <eustlb@users.noreply.huggingface.co>
