PR #25086 Generate: return `past_key_values`

Generate: return `past_key_values` #25086

gante merged 16 commits into huggingface:main from gante:return_past_kv

huggingface deleted a comment from github-actions on 2023-08-25

huggingface deleted a comment from github-actions on 2023-09-20

ArthurZucker changed the title ~~Generate: return `past_key_values`~~ [WIP] Generate: return `past_key_values` 2 years ago

1st commit, let's see what breaks

0ddfdfba

gante force pushed to 0ddfdfba 2 years ago

no need to accumulate

68bb3aed

fix docstrings, correct test

c408f62e

make fixup

17364b89

typo

e8aaa569

fix most cases

5b8fe64e

fix case for contrastive search

e27a1f92

some models always return past kv

e70f73f0

correct test for seq2seq

4b58cce7

now truly fix seq2seq

d5b34d38

fix final tests?

e89a1dda

now all working?

1088c585

add mixin test to test continuing generation

e9893d77

more versatile input code

b3cbbcd8

fix most models

668986cc

test works on nearly all models

70b5f8d2

gante marked this pull request as ready for review 2 years ago

gante requested a review from

amyeroberts 2 years ago

gante changed the title ~~[WIP] Generate: return `past_key_values`~~ Generate: return `past_key_values` 2 years ago

amyeroberts commented on 2023-11-02

amyeroberts approved these changes on 2023-11-02

gante merged a6c82d45 into main 2 years ago

gante deleted the return_past_kv branch 2 years ago

Reviewers

amyeroberts

ydshieh

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Generate: return `past_key_values` #25086 Merged

Generate: return `past_key_values` #25086

transformers
Generate: return `past_key_values`
#25086

Merged