Add sdpa and fa2 the Wav2vec2 family. (#30121)
* add sdpa to wav2vec.
Co-authored-by: kamilakesbi <kamil@huggingface.co>
Co-authored-by: jp1924 <jp42maru@gmail.com>
* add fa2 to wav2vec2
* add tests
* fix attention_mask compatibility with fa2
* minor dtype fix
* replace fa2 slow test
* fix fa2 slow test
* apply code review + add fa2 batch test
* add sdpa and fa2 to hubert
* sdpa and fa2 to data2vec_audio
* sdpa and fa2 to Sew
* sdpa to unispeech + unispeech sat
* small fix
* attention mask in tests
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com>
* add_speedup_benchmark_to_doc
---------
Co-authored-by: kamil@huggingface.co <kamil.akesbi@gmail.com>
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com>
