transformers
Refactor: Use Llama RoPE implementation for Falcon
#26933

Merged

Refactor: Use Llama RoPE implementation for Falcon #26933

gante merged 7 commits into huggingface:main from tomaarsen:feat/use_llama_rope_for_falcon

Use Llama RoPE implementation for Falcon

c4a8d523

gante requested a review from

gante 2 years ago

gante commented on 2023-10-19

Use standard cache format for Falcon

43d25ee4

Simplify apply_rotary_pos_emb, copy from Llama

e68b8e46

Remove unnecessary cache conversion test

931cd597

Merge branch 'main' into feat/use_llama_rope_for_falcon

dcde537a

gante approved these changes on 2023-10-24

gante requested a review from

ArthurZucker 2 years ago

Merge branch 'main' into feat/use_llama_rope_for_falcon

72d40bdc

Resolve copy complaint

cfbffe80

gante removed review request from

ArthurZucker 2 years ago

gante requested a review from

amyeroberts 2 years ago

amyeroberts approved these changes on 2023-11-02

gante merged 05ea7b79 into main 2 years ago

tomaarsen deleted the feat/use_llama_rope_for_falcon branch 2 years ago

Reviewers

amyeroberts

gante

Assignees

No one assigned

Labels

None yet

Milestone

No milestone