[`FA2`] Add flash attention for opt #26414
added flash attention for opt
626276f1
added to list
7800457d
fix use cache (#3)
689f5991
style fix
74e96876
fix text
cf923e88
test fix2
db8cf07e
reverted until 689f599
af67e0f5
torch fx tests are working now!
edf1610b
small fix
f34b680a
Merge branch 'main' into flash_attn_opt
90be2103
added TODO docstring
5cec2adb
Merge branch 'main' into flash_attn_opt
2bde7cf1
Merge branch 'main' into flash_attn_opt
db18d65f
changes
adfbb69c
susnato
changed the title Add flash attention for opt [`FA2`] Add flash attention for opt 2 years ago
Merge branch 'main' into flash_attn_opt
10ab9b30
comments and .md file modification
7d4c688a
susnato
force pushed
to
7d4c688a
2 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub