transformers
Fix Causality Handling in Flash Attention to Support Bidirectional Attention
#39707
Merged
Overview
Commits
4
Changes
View On GitHub

Fix Causality Handling in Flash Attention to Support Bidirectional Attention #39707

ArthurZucker merged 4 commits into huggingface:main from lucaswychan:fix_flash_attention_is_causal
lucaswychan
lucaswychan Fix the is_causal logic to enable bidirectional attention
b66c5720
ArthurZucker
ArthurZucker commented on 2025-07-28
lucaswychan
ArthurZucker
ArthurZucker approved these changes on 2025-08-11
ArthurZucker
ArthurZucker
github-actions
lucaswychan
vasqu
vasqu approved these changes on 2025-08-12
vasqu
ArthurZucker Merge branch 'main' into fix_flash_attention_is_causal
e0063bf3
ArthurZucker ArthurZucker enabled auto-merge (squash) 303 days ago
HuggingFaceDocBuilderDev
vasqu Merge branch 'main' into fix_flash_attention_is_causal
75d6afea
vasqu Merge branch 'main' into fix_flash_attention_is_causal
3353fafa
ArthurZucker ArthurZucker merged 0ce24f5a into main 303 days ago
vasqu
PavloFesenko
Inistlwq
vasqu
Inistlwq
Inistlwq
vasqu
Inistlwq

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum