:rotating_light: [`FA4`] Initial support #42435
vasqu
merged
42 commits into
huggingface:main
from
vasqu:fa4-support
initial implementation
e82beeb8
vasqu
commented
on 2025-11-26
Merge branch 'main' into fa4-support
1a45b34a
CB support
30c66822
change how we call item on max_seq_len_q/k
e9cdeea2
fix
40168b4f
tests
91a1b3be
fix fa2 clash
8d3dc6c8
unify the fa dispatch
bf1d5896
fix
f5b7f9c6
modernbert...
6288f44a
oops
15ed2eb9
parity test
6be5bbee
style
dad1b04c
nit
34c15c2a
sfc-gh-sbekman
commented
on 2025-12-01
Merge branch 'main' into fa4-support
ac8e3095
fixup imports for fa4
776a1af3
sfc-gh-sbekman
commented
on 2026-03-06
enable attention sinks, fixup logits checks in parity test
cc7a1b73
Merge branch 'main' into fa4-support
ca26ecf6
style
65912b2c
change dispatch logic and introduce lower bound for FA
d07749f4
Merge branch 'main' into fa4-support
95d644e5
style
ed88dcce
fix test
7fba6df6
min fa2, avoid 2x device sync
27acafe0
Merge branch 'main' into fa4-support
ba9fb595
style
afa0940a
simple min version instead of list
7223fe6d
fixup error message on non init check
da88dcf9
fixup up non init check a tad more
654db436
Merge branch 'main' into fa4-support
a690e55d
refactor some FA constants out to main fa utils
d3485dac
new marker for all fas needed
476789fc
oops
19e4c44f
style and make the fa kernel fallback generalized
08445b61
default none...
920bef73
more refactors
8ee8c567
style
cd2a9b34
vasqu
changed the title
fix
27e0d58b
this test faulty even on main, xformers can handle any shape apparent…
043f11f3
lets make this more robust, we should check for none within...
b0485b5b
fix
eae216e6
oops
15f6ba97
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub