transformers
Fix silent SDPA math-kernel fallback for GQA when key/value head_dim > 256 or differ
#46960
Open
Open
Fix silent SDPA math-kernel fallback for GQA when key/value head_dim > 256 or differ #46960
Butterfingrz
wants to merge
9 commits into
huggingface:main
from
Butterfingrz:fix/sdpa-gqa-large-head-dim-fallback
Fix silent SDPA math-kernel fallback for GQA with head_dim > 256
b41db1f8
Fix silent SDPA math-kernel fallback for GQA when key/value head_dim …
f572ef56
vasqu
commented
on 2026-06-30
Fix silent SDPA math-kernel fallback for GQA when key/value head_dim …
8a4bd6c8
Butterfingrz
changed the title
vasqu
commented
on 2026-07-01
Test SDPA GQA stays off the math kernel
32390c44
vasqu
approved these changes
on 2026-07-02
Consolidate SDPA GQA tests into one forced-backend test
0d4332d4
vasqu
commented
on 2026-07-02
Parametrize the SDPA GQA test by expected backend
b89dac94
vasqu
approved these changes
on 2026-07-02
Merge branch 'main' into fix/sdpa-gqa-large-head-dim-fallback
ab5ee8ff
Merge branch 'main' into fix/sdpa-gqa-large-head-dim-fallback
84563cac
disabled auto-merge 1 hour ago
Manually disabled by user
Manually disabled by user
Merge branch 'main' into fix/sdpa-gqa-large-head-dim-fallback
56178db9
Login to write a write a comment.
Login via GitHub