Add FA2 and `sdpa` support for SigLIP #31499
qubvel
merged
35 commits into
huggingface:main
from
qubvel:siglip-fa2-support
qubvel
changed the title
qubvel
commented
on 2024-06-24
Rebase to main
39006eff
Fix attention implementation autoset for tex and vision configs
24c7c421
Fixup
09499b94
Minor fixes
af7715bd
Fix copies
3416852b
Fix attention_mask for FA2
050051c1
Add eqvivalence tests for siglip
8c7bb9b4
Remove right padding test
b0f4d3ab
Uncomment flaky
045e56ef
Fix import
29814922
Add to docs
046eb5e2
Fix test message
bea1219e
Add sdpa
334fd7a9
Add sdpa equivalence test
a534a723
Add siglip sdpa to docs
b4e7b746
Fix typing for attention output
2edd76d7
Add sdpa tests
3a92411c
Fix signature of FA2
1b1311eb
Autoset attn_implementation in config
abf9aeee
Rename bsz -> batch_size
d3bf29cb
Move back autoset attn method
6ec4f794
Mark as flaky
a317f95a
Correct attention mask padding
21e29da0
[run-slow] siglip
39f4fafa
Add FA2 and sdpa docs
8929af73
Style fix
f006d64a
Remove flaky for FA2 test
8dbc12a4
Change attention implementation set
579ce7be
Change attn_implementaiton propogation
23457a22
Fix typos
2647b9e9
Add modality to assert message
598792f8
Add more sdpa backends in test
26c6770c
[run slow] siglip
e3ec20aa
Add math sdpa backend for all options
a92249e8
[run slow] siglip
1765a05a
Login to write a write a comment.
Login via GitHub