transformers
Allow easy registration of custom attention functions
#36889

Merged

Allow easy registration of custom attention functions #36889

Cyrilvallez merged 20 commits into main from register-attention-interface

github-actions marked this pull request as draft 274 days ago

Cyrilvallez marked this pull request as ready for review 274 days ago

github-actions requested a review from

ArthurZucker 274 days ago

github-actions requested a review from

Rocketknight1 274 days ago

sfc-gh-sbekman commented on 2025-03-21

ArthurZucker commented on 2025-03-24

Cyrilvallez force pushed from 51897196 to 38ef1e6f 269 days ago

Cyrilvallez force pushed from cb732f40 to 96b833da 269 days ago

ArthurZucker approved these changes on 2025-03-26

Update modeling_utils.py

bcde5907

style

28aa03f1

Update modeling_utils.py

dbd89697

Update modeling_utils.py

c8aa8eef

Update modeling_utils.py

da2429a9

Update modeling_utils.py

18c3a7ab

Update modeling_utils.py

ac532c64

Update modeling_utils.py

0c573f7e

add to init

fd24cac0

Update modeling_utils.py

eb308c9a

style

5fa23d7e

update

6f7c5fe6

Update modeling_utils.py

d6c571d7

Update modeling_utils.py

a91edc78

style

04d653c4

Add some doc

f163b2d7

Update _toctree.yml

f079215f

readd it for tgi/vllm compat

bc5cc32f

Cyrilvallez force pushed from a7f4bd80 to bc5cc32f 269 days ago

CIs

892adeb5

CIs

f68fa5b3

Cyrilvallez merged 788e1092 into main 269 days ago

Cyrilvallez deleted the register-attention-interface branch 269 days ago

sfc-gh-sbekman commented on 2025-03-26

Reviewers

ArthurZucker

sfc-gh-sbekman

Rocketknight1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Allow easy registration of custom attention functions #36889 Merged

Allow easy registration of custom attention functions #36889

transformers
Allow easy registration of custom attention functions
#36889

Merged