transformers
[Model] Refactor modernbert with the attention interface
#43030
Merged
Merged
[Model] Refactor modernbert with the attention interface #43030
vasqu
merged
55 commits into
huggingface:main
from
YangKai0616:Refactor-dev
Refactor FA interface
ddcf51d2
Simplify code
892f5e4e
Update
d9e358f2
Simplify the code
34673c9e
Remove comments
49081e18
Fix UT
93386c46
Fix _attn_implementation UT
aa7a5863
Fix TimmWrapperForImageClassification sdpa dispatch UT
1fcb85c8
Merge branch 'main' into main
dd0b336a
Remove unused parameter
b7a28681
Revise based on comments
21521d2e
Merge branch 'main' into Refactor-dev
17c3ba46
Merge main branch
0a823792
Merge branch 'main' into Refactor-dev
f69f0511
Fix CI error
d247727a
Fix UT
a253cfc1
Merge branch 'main' into Refactor-dev
e845d8d8
Refine code based comments
f9000a5e
Merge branch 'main' into Refactor-dev
43d4ec91
check_config_attributes
73dd6845
Fix UT errors
9f0cb5dd
Merge branch 'main' into Refactor-dev
1c052a47
Refine code
6b3a3060
Revert test_modeling_common.py
302703e8
Merge branch 'main' into Refactor-dev
e01e3437
Revert file
3dca2baf
Revert file
a8eceb44
Fix rotary(.float())
79118df8
Fix silding window errors
16bd9628
Update modeling files
c6a29a9b
Fix
70f941c6
Fix flash sdpa eager
c0a63681
style
ee178c89
Merge branch 'main' into Refactor-dev
3d66cb38
Merge main
49cfbcf3
Fix CI error
80f6f6d6
Update
26813999
Update the doc
3bc2c320
Merge branch 'main' into Refactor-dev
c63ddc15
Update code based comments
461bf1f2
make fix-repo
e9638d2a
Fix CI
4e0f677a
YangKai0616
commented
on 2026-01-21
check_config_attributes
9bd95fdf
Merge branch 'main' into Refactor-dev
594ee046
fix
1d2101f8
refactor tests a bit more + fa integration test
a8874a0b
style
b6c50a46
Fix UTs
587cb4f0
vasqu
approved these changes
on 2026-01-22
Merge branch 'main' into Refactor-dev
d3b23bc7
resolve conflicts
5b28ad6d
Merge branch 'main' into Refactor-dev
001f85b3
Update src/transformers/models/modernbert/configuration_modernbert.py
9f88012b
Revised based on comments.
38a4674a
Merge branch 'main' into Refactor-dev
2ec56b78
Merge branch 'main' into Refactor-dev
af65f3f6
Login to write a write a comment.
Login via GitHub