Fix Whisper CI (#34617)
* Revert "Revert "Fix Whisper CI" (#34605)"
This reverts commit 74d3824cc0725829e7d92e1d43b97be1f18454f8.
* update
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
