transformers
[`Llama ROPE`] Fix torch export but also slow downs in forward
#29198
Merged
Overview
Commits
25
Changes
View On GitHub

[`Llama ROPE`] Fix torch export but also slow downs in forward #29198

ArthurZucker merged 25 commits into main from llama-sincos-bc
ArthurZucker
ArthurZucker remove control flow
c72d04c0
ArthurZucker update gptneox
9c6a8777
ArthurZucker update ....
d04c6975
ArthurZucker nits
614b8c35
HuggingFaceDocBuilderDev
ArthurZucker Actually let's just break. Otherwise we are silently failing which im…
9c3c6f5e
ArthurZucker ArthurZucker requested a review from LysandreJik LysandreJik 2 years ago
ArthurZucker version BC
12d60c62
ArthurZucker ArthurZucker requested a review from younesbelkada younesbelkada 2 years ago
ArthurZucker fix tests
0fcd9ad3
younesbelkada
younesbelkada approved these changes on 2024-02-22
ArthurZucker ArthurZucker marked this pull request as ready for review 2 years ago
ArthurZucker ArthurZucker requested a review from gante gante 2 years ago
gante
gante approved these changes on 2024-02-22
fxmarty
ArthurZucker
ArthurZucker fix eager causal
3eeef21f
ArthurZucker Merge branch 'main' of github.com:huggingface/transformers into llama…
0df9d474
ArthurZucker nit
d95f3ed4
ArthurZucker Merge branch 'main' of github.com:huggingface/transformers into llama…
aec200ab
ArthurZucker add a test
4a73df12
ArthurZucker style
4323e414
ArthurZucker nits
7f5ac69d
ArthurZucker nits
b7d1884d
ArthurZucker more nits for the test
100ab52e
ArthurZucker update and fix
ca82c260
ArthurZucker make sure cuda graphs are not skipped
409d97e4
ArthurZucker read token is needed for meta llama
6b849368
ArthurZucker update!
a01d0e18
ArthurZucker fiixup
7e2c08bf
ArthurZucker compile test should be slow
0809a9f1
ArthurZucker ArthurZucker changed the title [`Llama ROPE`] Export but also slow down in forward. [`Llama ROPE`] Fix torch export but also slow downs in forward 2 years ago
ArthurZucker Merge branch 'main' of github.com:huggingface/transformers into llama…
6f2823cd
ArthurZucker fix thet fix copies
5cfa3fbd
ArthurZucker stle 🫠
14db98ef
ArthurZucker ArthurZucker merged 8a8a0a4a into main 2 years ago
ArthurZucker ArthurZucker deleted the llama-sincos-bc branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum