[`Flash Attention`] Fix flash attention integration #40002
vasqu
merged
39 commits into
huggingface:main
from
vasqu:fix-fa-integration
fix flash attention
0ccc67d0
i got a stroke reading that comment
0f97be09
vasqu
commented
on 2025-08-07
change dropout kwarg back to before
0a454160
rename _fa3... as it's used for multiple variants and should work as …
92e2075a
ArthurZucker
approved these changes
on 2025-08-07
Merge branch 'main' into fix-fa-integration
22574dc9
simplify imports and support kwargs for fa
3581bd6b
style
2f607ba0
vasqu
commented
on 2025-08-07
vasqu
commented
on 2025-08-07
vasqu
commented
on 2025-08-07
vasqu
commented
on 2025-08-07
fix comments order
49ce7aeb
ArthurZucker
approved these changes
on 2025-08-08
small fix
5f7d937b
skip kernels test (causes cuda illegal memories w/o cleanup), fix fa …
d21095c1
style
36bfffbb
vasqu
commented
on 2025-08-08
vasqu
commented
on 2025-08-08
vasqu
commented
on 2025-08-08
vasqu
commented
on 2025-08-08
vasqu
commented
on 2025-08-08
Merge branch 'main' into fix-fa-integration
9ec8c455
allow fullgraph by preloading on init
1612b56a
make globals "private"
ba8fd00e
Merge branch 'main' into fix-fa-integration
5240985f
ci pls be happy
3dbf11ab
change skip conditions based on backend flag (indicating missing mask…
d9d8ff70
move globals support to a function to prepare kwargs
ec0fbf3e
style
a6996f51
Merge branch 'main' into fix-fa-integration
ce0e5860
generalize supported kwargs
86c9e813
small change to doc
3ae14ecf
fix
89b8f956
Merge branch 'main' into fix-fa-integration
24512e4c
Merge branch 'main' into fix-fa-integration
ec41ac5c
Merge branch 'main' into fix-fa-integration
74a89870
add comments
8f912197
vasqu
commented
on 2025-08-12
style
6a0a3a19
Merge branch 'main' into fix-fa-integration
54ed29e3
revert prep during generate
7016548a
Merge branch 'main' into fix-fa-integration
d9da331e
style
a996bd58
revert weird style changes
07fafe1e
add fa kwarg prep during generate with fixes back
a98fac44
how did this even happen
9971d750
how
5e2d35f4
gante
approved these changes
on 2025-08-12
Merge branch 'main' into fix-fa-integration
85cb1b1b
ArthurZucker
approved these changes
on 2025-08-12
add comment
4ad364c9
Merge branch 'main' into fix-fa-integration
cb89dbee
Reviewers
Assignees
No one assigned
Labels
for patch
Milestone
No milestone
Login to write a write a comment.
Login via GitHub