transformers
improve(llama): Faster apply_rotary_pos_emb
#22785
Merged
Overview
Commits
1
Changes
View On GitHub

improve(llama): Faster apply_rotary_pos_emb #22785

amyeroberts merged 1 commit into huggingface:main from fpgaminer:improve-llama-speed-20230415a
fpgaminer
fpgaminer improve(llama): Faster apply_rotary_pos_emb
2af4e6d0
HuggingFaceDocBuilderDev
gante
gante approved these changes on 2023-04-17
gante gante requested a review from amyeroberts amyeroberts 2 years ago
amyeroberts
amyeroberts approved these changes on 2023-04-17
amyeroberts amyeroberts merged 626c1b8a into main 2 years ago
neggert
amyeroberts

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum