PR #49811 Remove sdpa support for models using softcapping

Remove sdpa support for models using softcapping #49811

Cyrilvallez merged 6 commits into main from warn-dropped-softcap

Warn when sdpa or a flash kernel drops the attention softcap

54e9f02e

qgallouedec requested a review from

vasqu 7 days ago

qgallouedec requested a review from

Cyrilvallez 7 days ago

unsupported sdpa

1b42ade7

Cyrilvallez commented on 2026-10-21

Cyrilvallez changed the title ~~Warn when sdpa or a flash kernel drops the attention softcap~~ Remove sdpa support for models using softcapping 6 days ago

others

e73d668a

no need for tracing check, better to raise there

389b29e9

Cyrilvallez approved these changes on 2026-10-21

vasqu commented on 2026-10-21

vasqu approved these changes on 2026-10-21

raise instead

d5e15927

remove test

adfe4010

Cyrilvallez merged 7d3ae42e into main 6 days ago

Cyrilvallez deleted the warn-dropped-softcap branch 6 days ago

Reviewers

Cyrilvallez

vasqu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Remove sdpa support for models using softcapping #49811 Merged

Remove sdpa support for models using softcapping #49811

transformers
Remove sdpa support for models using softcapping
#49811

Merged