transformers
[wav2vec2_conformer/bert][SeamlessM4T/v2] Support attn_implementation=sdpa dispatch
#46196
Open
Overview
Commits
16
Changes
View On GitHub

[wav2vec2_conformer/bert][SeamlessM4T/v2] Support attn_implementation=sdpa dispatch #46196

YangKai0616 wants to merge 16 commits into huggingface:main from YangKai0616:attn-SeamlessM4T-v2
YangKai0616
YangKai0616 [SeamlessM4T/v2] Support attn_implementation=sdpa dispatch
6716ce5b
YangKai0616 simplify code
090889eb
YangKai0616
vasqu
vasqu commented on 2026-05-25
YangKai0616 Init
ca71e021
YangKai0616 config
d88712d0
YangKai0616 prepare relative bias function
f2178f94
YangKai0616 TP friendly
631e4822
YangKai0616 func comments
e2c47f3f
YangKai0616 parameter scale
fb555269
YangKai0616 Fix multi-device error
603f19ed
YangKai0616 Code quality
abfb3f42
vasqu
vasqu commented on 2026-05-27
YangKai0616 Refactor
88b0e406
YangKai0616 Apply a refactor to wav2vec2
716465bd
YangKai0616 Resolve merge conflicts: keep both fsdp and FlashAttentionKwargs imports
4bec1a1d
YangKai0616 Fix copy consistency
e436b2de
YangKai0616 Doc
2e4446f4
YangKai0616 YangKai0616 changed the title [SeamlessM4T/v2] Support attn_implementation=sdpa dispatch [SeamlessM4T/v2][wav2vec2_conformer/bert] Support attn_implementation=sdpa dispatch 8 days ago
YangKai0616 YangKai0616 changed the title [SeamlessM4T/v2][wav2vec2_conformer/bert] Support attn_implementation=sdpa dispatch [wav2vec2_conformer/bert][SeamlessM4T/v2] Support attn_implementation=sdpa dispatch 8 days ago
YangKai0616 Skip flash sdpa UT
4aab4347
github-actions
YangKai0616
vasqu
vasqu commented on 2026-06-05

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum