PR #37406 [`Flex Attn`] Fix torch 2.5.1 incompatibilities

[`Flex Attn`] Fix torch 2.5.1 incompatibilities #37406

vasqu merged 10 commits into huggingface:main from vasqu:flex-torch2.5.1-patches

remove compile on mask creation, ensure kv blocks do not explode on i…

a4e1058c

github-actions marked this pull request as draft 1 year ago

vasqu marked this pull request as ready for review 1 year ago

github-actions requested a review from

MekkCyber 1 year ago

github-actions requested a review from

SunMarc 1 year ago

trigger ci

76b059ae

switch dynamic compilation to false

95133c38

vasqu commented on 2025-04-10

winglian commented on 2025-04-10

Merge branch 'main' into flex-torch2.5.1-patches

4fdd6a4f

Merge branch 'main' into flex-torch2.5.1-patches

9f65c33f

Cyrilvallez commented on 2025-06-25

patch new masking functions as well

92458b18

vasqu requested a review from

Cyrilvallez 1 year ago

vasqu removed review request from

SunMarc 1 year ago

vasqu removed review request from

MekkCyber 1 year ago

Merge branch 'main' into flex-torch2.5.1-patches

9223e560

Cyrilvallez commented on 2025-06-25

add len check

47cd2390

Cyrilvallez approved these changes on 2025-06-25

i was wrong

c8695127

Cyrilvallez approved these changes on 2025-06-26

last comment

1547ee99

vasqu merged 58c76892 into main 1 year ago

vasqu deleted the flex-torch2.5.1-patches branch 1 year ago

Reviewers

Cyrilvallez

winglian

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers [`Flex Attn`] Fix torch 2.5.1 incompatibilities #37406 Merged

[`Flex Attn`] Fix torch 2.5.1 incompatibilities #37406

transformers
[`Flex Attn`] Fix torch 2.5.1 incompatibilities
#37406

Merged