PR #26486 [`FA2`] Add flash attention for `GPT-Neo`

[`FA2`] Add flash attention for `GPT-Neo` #26486

amyeroberts merged 9 commits into huggingface:main from susnato:flash_attn_gpt_neo

added flash attention for gpt-neo

4d94695b

younesbelkada approved these changes on 2023-10-03

younesbelkada requested a review from

LysandreJik 2 years ago

ArthurZucker commented on 2023-10-04

small change

4c174b12

readme updated

af5c2f96

d1cc784b

Merge branch 'main' into flash_attn_gpt_neo

e52dd1d9

changes

4fddc5a2

amyeroberts approved these changes on 2023-11-02

removed padding_mask

d6844ec5

susnato changed the title ~~Add flash attention for `GPT-Neo`~~ [`FA2`] Add flash attention for `GPT-Neo` 2 years ago

susnato requested a review from

amyeroberts 2 years ago

amyeroberts approved these changes on 2023-11-03

Update src/transformers/models/gpt_neo/modeling_gpt_neo.py

437f5e3b

Merge branch 'main' into flash_attn_gpt_neo

0aad288c

amyeroberts merged 0ded2815 into main 2 years ago

Reviewers

amyeroberts

younesbelkada

ArthurZucker

LysandreJik

Assignees

No one assigned

Labels

None yet

Milestone

No milestone