transformers
Generate: handle `cache_position` update in `generate`
#29467

Merged

Generate: handle `cache_position` update in `generate` #29467

gante merged 6 commits into huggingface:main from gante:update_cache_position

gante force pushed 1 year ago

gante marked this pull request as ready for review 1 year ago

gante requested a review from

ArthurZucker 1 year ago

ArthurZucker approved these changes on 2024-03-07

tmp commit

28ef8d3b

handle corner cases

d0be7a23

static cache seq len

0fabea67

gemma

e6277fa9

deprecation cycle for seen_tokens

8c29e496

derp

10360b30

gante force pushed to 10360b30 1 year ago

gante merged 23db187d into main 1 year ago

gante deleted the update_cache_position branch 1 year ago

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone