transformers
Support for Flash Attention 3
#38972
Merged
Overview
Commits
11
Changes
View On GitHub

Support for Flash Attention 3 #38972

ArthurZucker merged 11 commits into huggingface:main from swiss-ai:FA3
EduardDurech
EduardDurech Support `flash_attn_3`
2f65d5c8
EduardDurech Add tests for Flash Attention 2 and 3 parity
18dbd84b
EduardDurech EduardDurech marked this pull request as draft 252 days ago
EduardDurech EduardDurech force pushed from 414ec8f8 to 46069d4d 252 days ago
EduardDurech EduardDurech force pushed from 46069d4d to 629deca9 252 days ago
EduardDurech EduardDurech force pushed from 629deca9 to 230f64f8 252 days ago
EduardDurech ci fix
93f29846
EduardDurech EduardDurech force pushed from 230f64f8 to 93f29846 251 days ago
EduardDurech EduardDurech marked this pull request as ready for review 251 days ago
github-actions github-actions requested a review from ArthurZucker ArthurZucker 251 days ago
github-actions github-actions requested a review from ydshieh ydshieh 251 days ago
ArthurZucker
ArthurZucker approved these changes on 2025-06-24
EduardDurech FA2 compatibiity
81548db6
EduardDurech EduardDurech force pushed from ed6e3c0b to 81548db6 250 days ago
EduardDurech ci fix
56161870
EduardDurech
EduardDurech Test naming consistency
30f71343
EduardDurech Merge branch 'main' into FA3
80d54d49
EduardDurech ci fix
241f8726
EduardDurech
ArthurZucker
ArthurZucker approved these changes on 2025-06-25
EduardDurech Deprecation warning for `prepare_fa2_from_position_ids`
9bc44557
EduardDurech Merge branch 'main' into FA3
bbe6d5a4
EduardDurech ci fix
3dd8796e
ArthurZucker ArthurZucker merged a2eb75c8 into main 249 days ago
ArthurZucker
1ytic
1ytic
EduardDurech
ArthurZucker
EduardDurech
EduardDurech
EduardDurech
EduardDurech
a-r-r-o-w
1ytic
ArthurZucker
kisseternity
ArthurZucker
kisseternity

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum