transformers
[`Mistral`] Add Flash Attention-2 support for `mistral`
#26464
Merged
Overview
Commits
28
Changes
View On GitHub

[`Mistral`] Add Flash Attention-2 support for `mistral` #26464

younesbelkada merged 28 commits into huggingface:main from younesbelkada:add-mistral-fa-2
younesbelkada
younesbelkada add FA-2 support for mistral
5d9bc483
younesbelkada fixup
0983d88b
HuggingFaceDocBuilderDev
younesbelkada add sliding windows
b8c91980
younesbelkada Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t…
d7408497
timlacroix
timlacroix
timlacroix commented on 2023-09-28
timlacroix
timlacroix commented on 2023-09-28
timlacroix
timlacroix commented on 2023-09-28
younesbelkada fixing few nits
bd58ca72
younesbelkada v1 slicing cache - logits do not match
43b02897
ArthurZucker
ArthurZucker commented on 2023-09-29
younesbelkada add comment
ed2616f2
younesbelkada fix bugs
7cafc2d7
younesbelkada more mem efficient
2b8c7b46
younesbelkada add warning once
4a3387df
younesbelkada add warning once
885b6014
younesbelkada oops
172d99a4
younesbelkada fixup
253b3830
younesbelkada more comments
e4d0fb7a
younesbelkada
younesbelkada copy
a245722d
younesbelkada Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t…
30798964
younesbelkada
younesbelkada add safety checker
e71c50d3
younesbelkada Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t…
a21d903a
younesbelkada fixup
5d1f5890
ArthurZucker
ArthurZucker approved these changes on 2023-10-03
younesbelkada younesbelkada marked this pull request as ready for review 2 years ago
younesbelkada Update src/transformers/models/mistral/modeling_mistral.py
b478e047
younesbelkada copied from
2fe2f490
younesbelkada up
25789d1c
younesbelkada raise when padding side is right
05ec7f47
younesbelkada Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t…
5a79195a
younesbelkada fixup
f9a69bcc
younesbelkada add doc + few minor changes
6a48dd31
younesbelkada Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t…
76763c7c
younesbelkada fixup
c2869469
younesbelkada younesbelkada changed the title [`Mistral`] Add mistral + FA 2 [`Mistral`] Add Flash Attention-2 support for `mistral` 2 years ago
younesbelkada younesbelkada requested a review from ArthurZucker ArthurZucker 2 years ago
ArthurZucker
ArthurZucker approved these changes on 2023-10-03
younesbelkada younesbelkada merged ae9a344c into main 2 years ago
younesbelkada younesbelkada deleted the add-mistral-fa-2 branch 2 years ago
vince62s
vince62s commented on 2023-10-11

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum