Adds ATen fallback for scaled_dot_product_attention #21107
prathikr
merged
35 commits into
main
from
prathikrao/attn-aten-fallback
attn aten fallback
f22b8dc8
use correct operator names
612e425a
formatting
bdcfebba
add unit test
80c3107d
formatting
2b29b4c5
use pytorch sdpa kernel
d2b85663
bug fix
0ca8fa00
lint
8999ff2f
use different kernel
6bf30188
formatting
35bd07ae
include Peng's & Vincent's editS
dd1849a8
adjust test and comments
8219ec97
move import inside test
65c2cb7e
merge with master
b5f58637
feature flag
18648ade
add documentation
be9ce0a1
minor fixes
e269e893
doc update
d3cc487a
peng fix, xavier suggestion
f5005289
bug fix
c4cdab61
bug fix
c05a5ee6
bug fix
f82bd48d
adjust unit test
668409b9
adjust checks
b5f11693
grad input fix
31becabb
handle both with and without bias
5aa147d9
full mask
37eb6bc2
github-advanced-security
commented
on 2024-07-09
merge with main
ae3b5e7f
lint
3484926f
add version check for tesT
8d0e8795
grad output adjustment
b72a042e
add more docs
6b4dd101
pengwa
commented
on 2024-07-17
pengwa
commented
on 2024-07-17
remove support for masked attention
999b04bc
adjust docs
b1fe4899
pengwa
approved these changes
on 2024-07-19
Merge remote-tracking branch 'origin' into prathikrao/attn-aten-fallback
4ab54e65
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub