PR #29109 Llama: fix batched generation

Llama: fix batched generation #29109

gante merged 3 commits into huggingface:main from gante:batched_llama

gante requested a review from

ArthurZucker 2 years ago

gante marked this pull request as ready for review 2 years ago

gante commented on 2024-02-19

gante changed the title ~~batched llama~~ Llama: fix batched generation 2 years ago

batched llama

33b3cfb7

fix other cache tests

a64dc2de

gante force pushed to a64dc2de 2 years ago

ArthurZucker approved these changes on 2024-02-20

add bc

9b2c3f7f

gante merged 7d312ad2 into main 2 years ago

gante deleted the batched_llama branch 2 years ago

ArthurZucker commented on 2024-02-22

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone