transformers
:rotating_light: Modify ModernBERT's default attention implementation to stop using FA
#43764
Merged
Overview
Commits
4
Changes
View On GitHub

:rotating_light: Modify ModernBERT's default attention implementation to stop using FA #43764

vasqu merged 4 commits into huggingface:main from modernbert-attn
YangKai0616
YangKai0616 Modify ModernBERT's default attention implementation to stop using FA
d64719ea
YangKai0616 Style
79e51066
YangKai0616
YangKai0616 commented on 2026-02-05
vasqu
vasqu approved these changes on 2026-02-05
vasqu
YangKai0616 Revised based on comments
855c7957
YangKai0616
YangKai0616 commented on 2026-02-06
YangKai0616 Update doc
dab4df66
github-actions
YangKai0616
YangKai0616
vasqu vasqu changed the title Modify ModernBERT's default attention implementation to stop using FA :rotating_light: Modify ModernBERT's default attention implementation to stop using FA 139 days ago
vasqu
vasqu approved these changes on 2026-02-06
vasqu vasqu enabled auto-merge (squash) 139 days ago
vasqu vasqu merged 2db2c887 into main 139 days ago
HuggingFaceDocBuilderDev

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum