PR #30910 Add YaRN and Dynamic-YaRN RoPE Scaling Methods

Add YaRN and Dynamic-YaRN RoPE Scaling Methods #30910

gante merged 7 commits into huggingface:main from mig-mfreitas:yarn-rope-scaling

Add YaRN and Dynamic-YaRN RoPE Scaling Methods

cc9b82e9

gante commented on 2024-05-27

Merge remote-tracking branch 'upstream/main' into yarn-rope-scaling

fc161dde

Merge remote-tracking branch 'upstream/main' into yarn-rope-scaling

1044c7be

Refactor YaRN implementation for LLaMA

85552b3c

gante commented on 2024-06-17

ArthurZucker commented on 2024-07-09

Refactor Tensor Building Logic for YaRN

d84baa91

Merge remote-tracking branch 'upstream/main' into yarn-rope-scaling

fdea0000

remove unwanted file

a555034a

gante approved these changes on 2024-07-23

gante merged 34b43211 into main 1 year ago

Reviewers

gante

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone