transformers
[Roformer] Fixing a bug in RoFormerEncoder where it was ignoring the length of past_key_values when generating as a decoder
#22416

Merged

[Roformer] Fixing a bug in RoFormerEncoder where it was ignoring the length of past_key_values when generating as a decoder #22416

ArthurZucker merged 4 commits into huggingface:main from TheWall9:roformer-generate

fix RoFormerEncoder postion embedding when generate as decoder

51cee2b4

younesbelkada commented on 2023-03-28

make fixup

d2f93c67

add test case for check generate with past key values

bd5ede48

younesbelkada approved these changes on 2023-03-28

younesbelkada requested a review from

ArthurZucker 2 years ago

younesbelkada requested a review from

sgugger 2 years ago

sgugger approved these changes on 2023-03-29

ArthurZucker approved these changes on 2023-04-03

remove duplicating code

069b6cbb

ArthurZucker merged ad5e9b6c into main 2 years ago

Reviewers

ArthurZucker

sgugger

younesbelkada

Assignees

No one assigned

Labels

None yet

Milestone

No milestone