transformers
🚨[wav2vec2] Support attn_implementation=sdpa dispatch
#46196

Merged

🚨[wav2vec2] Support attn_implementation=sdpa dispatch #46196

IlyasMoutawwakil merged 53 commits into huggingface:main from attn-SeamlessM4T-v2

[SeamlessM4T/v2] Support attn_implementation=sdpa dispatch

6716ce5b

simplify code

090889eb

vasqu commented on 2026-05-25

Init

ca71e021

config

d88712d0

prepare relative bias function

f2178f94

TP friendly

631e4822

func comments

e2c47f3f

parameter scale

fb555269

Fix multi-device error

603f19ed

Code quality

abfb3f42

vasqu commented on 2026-05-27

Refactor

88b0e406

Apply a refactor to wav2vec2

716465bd

Resolve merge conflicts: keep both fsdp and FlashAttentionKwargs imports

4bec1a1d

Fix copy consistency

e436b2de

Doc

2e4446f4

YangKai0616 changed the title ~~[SeamlessM4T/v2] Support attn_implementation=sdpa dispatch~~ [SeamlessM4T/v2][wav2vec2_conformer/bert] Support attn_implementation=sdpa dispatch 119 days ago

YangKai0616 changed the title ~~[SeamlessM4T/v2][wav2vec2_conformer/bert] Support attn_implementation=sdpa dispatch~~ [wav2vec2_conformer/bert][SeamlessM4T/v2] Support attn_implementation=sdpa dispatch 119 days ago

Skip flash sdpa UT

4aab4347

vasqu commented on 2026-06-05

Update

751ff1b2

vasqu commented on 2026-06-08

rename func

3ccfd6d3

scale->scaling

6796b38f

Refine

8d7856f4

copy and code quality

35dd9c5f

Merge branch 'main' into attn-SeamlessM4T-v2

94d4ff1b

copy and ruff

35510026

Fix CI

d51ba48c

Fix CI

9ac3ec2b

YangKai0616 changed the title ~~[wav2vec2_conformer/bert][SeamlessM4T/v2] Support attn_implementation=sdpa dispatch~~ [wav2vec2] Support attn_implementation=sdpa dispatch 106 days ago

Refine data2vec_audio

54e9f9ef

vasqu commented on 2026-06-19

Refine

f6fd9461

Merge branch 'main' into attn-SeamlessM4T-v2

35bf14ef

resolve conflicts

c8837b7a

vasqu commented on 2026-06-26

refine

2eb43c3d

Merge branch 'main' into attn-SeamlessM4T-v2

fe84e3f2

YangKai0616 changed the title ~~[wav2vec2] Support attn_implementation=sdpa dispatch~~ 🚨[wav2vec2] Support attn_implementation=sdpa dispatch 88 days ago

Fix CI

824cdcd4

Merge branch 'main' into attn-SeamlessM4T-v2

2dbfe5d0

Merge branch 'main' into attn-SeamlessM4T-v2

11098889

Fix `is_causal` SymBool leak in SDPA under torch.export

7fc4ce81

YangKai0616 force pushed from 0a04bb4e to 7fc4ce81 79 days ago

Fix SymBool error and conflicts

b967acc0

comments

4d432f50

Merge branch 'main' into attn-SeamlessM4T-v2

8d8dd5f9

YangKai0616 commented on 2026-07-08

Merge branch 'main' into attn-SeamlessM4T-v2

2d7f091b

vasqu commented on 2026-07-17

Merge remote-tracking branch 'upstream/main' into attn-SeamlessM4T-v2

4aa34350

refine

8a6a4ca9

ruff

ae8d3af0

Merge branch 'main' into attn-SeamlessM4T-v2

d5cec436

vasqu commented on 2026-08-03

refine

a5dd099c

Merge branch 'main' into attn-SeamlessM4T-v2

dcef534a

YangKai0616 commented on 2026-08-05

Add TODO

abba6b2d

Merge branch 'main' into attn-SeamlessM4T-v2

da00d6aa

huggingface deleted a comment from github-actions on 2026-08-14

refine TODO comments

e65812c0

Merge branch 'main' into attn-SeamlessM4T-v2

115fc946

IlyasMoutawwakil commented on 2026-08-18

IlyasMoutawwakil approved these changes on 2026-08-18

Merge branch 'main' into attn-SeamlessM4T-v2

bf61f417

Skip dynamic export UT for SeamlessM4T/v2 speech models

2e44fdc3

Merge branch 'main' into attn-SeamlessM4T-v2

0dddd623

Merge branch 'main' into attn-SeamlessM4T-v2

52a43459

IlyasMoutawwakil enabled auto-merge 36 days ago

IlyasMoutawwakil merged 2b296305 into main 36 days ago

Reviewers

IlyasMoutawwakil

vasqu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers 🚨[wav2vec2] Support attn_implementation=sdpa dispatch #46196 Merged

🚨[wav2vec2] Support attn_implementation=sdpa dispatch #46196

transformers
🚨[wav2vec2] Support attn_implementation=sdpa dispatch
#46196

Merged