PR #30068 Fix on "cache position" for assisted generation

Fix on "cache position" for assisted generation #30068

zucchini-nlp merged 9 commits into huggingface:main from zucchini-nlp:assisted_gen

zucchini-nlp requested a review from

gante 2 years ago

gante commented on 2024-04-18

zucchini-nlp commented on 2024-04-19

clean commit history I hope

c5d3c0fc

zucchini-nlp force pushed to c5d3c0fc 2 years ago

get kv seq length correctly

640da9b7

gante commented on 2024-04-19

gante approved these changes on 2024-04-19

PR suggestions

4db61308

zucchini-nlp requested a review from

gante 2 years ago

Merge branch 'huggingface:main' into assisted_gen

be6b4775

gante approved these changes on 2024-04-22

gante requested a review from

amyeroberts 2 years ago

Update src/transformers/testing_utils.py

54ea7aea

add comment

14f423d7

amyeroberts commented on 2024-04-22

give gpt bigcode it's own overriden method

298d1d75

Merge branch 'huggingface:main' into assisted_gen

edb8448e

remove code

efd10cb4

amyeroberts approved these changes on 2024-04-23

zucchini-nlp merged 77b59dce into main 2 years ago

Reviewers

amyeroberts

gante

Assignees

No one assigned

Labels

None yet

Milestone

No milestone