[`GPT2`] Add SDPA support #31172
ArthurZucker
merged
16 commits into
huggingface:main
from
vasqu:gpt2-sdpa
`gpt2` sdpa support
3dc08bd3
fix (at least) one test, style, repo consistency
e425b89c
fix sdpa mask in forward --> fixes generation
ad6c985d
test
9c729a34
test2
322fb615
test3
bb30edfa
test4
3953454d
simplify shapes for attn mask creation and small comments
d963ad5d
hub fail test
91fe5338
benchmarks
4a7b1664
flash attn 2 mask should not be inverted on enc-dec setup
f0d7d2ac
fix comment
3c12ee06
younesbelkada
commented
on 2024-06-03
younesbelkada
approved these changes
on 2024-06-03
apply some suggestion from code review
95b2440f
change elif logic
c6651165
ArthurZucker
commented
on 2024-06-06
[run-slow] gpt2
4811cb55
modify `test_gpt2_sample_max_time` to follow previous assertion patterns
8b33cd79
vasqu
commented
on 2024-06-07
younesbelkada
approved these changes
on 2024-06-12
ArthurZucker
approved these changes
on 2024-06-19
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub