PR #27661 [`FA-2`] Add Flash Attention to `Phi`

[`FA-2`] Add Flash Attention to `Phi` #27661

ArthurZucker merged 6 commits into huggingface:main from susnato:flash_attn_phi

younesbelkada approved these changes on 2023-11-23

younesbelkada requested a review from

ArthurZucker 2 years ago

ArthurZucker commented on 2023-11-23

younesbelkada approved these changes on 2023-12-06

younesbelkada commented on 2023-12-06

add FA and modify doc file

cdcd671c

test_flash_attn_2_generate_padding_right test overwritten

17185d89

comment

a33fa732

modify persimmon modeling file

e16090b1

added speedup graph

30cac2e5

more changes

9e22498e

susnato force pushed to 9e22498e 2 years ago

younesbelkada approved these changes on 2023-12-06

younesbelkada requested a review from

ArthurZucker 2 years ago

ArthurZucker approved these changes on 2023-12-07

ArthurZucker merged f84d85ba into main 2 years ago

Reviewers

ArthurZucker

younesbelkada

Assignees

No one assigned

Labels

None yet

Milestone

No milestone