Re-enable SDPA's FA2 path #30070
fxmarty
merged
22 commits into
huggingface:main
from
fxmarty:reenable-fa2-sdpa
tentatively re-enable FA2 + SDPA
0f8e6ac7
better comment
8898595f
_ignore_causal_mask_sdpa as staticmethod
2471be2d
type hints
fa14c738
use past_seen_tokens instead
76e75eb3
Merge branch 'main' into reenable-fa2-sdpa
9793adde
enable copied from for sdpa
eebfa090
ruff
701586e5
fxmarty
commented
on 2024-04-05
llama simplifications on review
0609b437
remove unnecessary self.is_causal check
3ca589db
fix copies
471c1017
cleaning
73555554
precise message
42692de0
fxmarty
commented
on 2024-04-08
better doc
3f92c7d3
add test
c742e797
BowenBao
commented
on 2024-04-10
warner-benjamin
requested changes
on 2024-04-11
warner-benjamin
approved these changes
on 2024-04-15
Merge branch 'main' into reenable-fa2-sdpa
fbba2458
Merge branch 'main' into reenable-fa2-sdpa
4c41786e
simplify
a94a441d
Update src/transformers/models/llama/modeling_llama.py
38fb6f6e
Update src/transformers/models/llama/modeling_llama.py
70d903ff
Update src/transformers/models/llama/modeling_llama.py
86e223e5
style
290a267e
ArthurZucker
approved these changes
on 2024-04-17
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub