transformers
[generate] Never use `cache_position` anymore in generation
#44816
Merged

[generate] Never use `cache_position` anymore in generation #44816

Cyrilvallez
Cyrilvallez remove from generation
d93347f6
HuggingFaceDocBuilderDev
Cyrilvallez Merge branch 'main' into fully-remove-cache-pos-from-generate
6ec81651
Cyrilvallez Cyrilvallez changed the title [generate] Never use `cache_position` anymore in generation [generate] 🚨 Never use `cache_position` anymore in generation 162 days ago
Cyrilvallez Cyrilvallez changed the title [generate] 🚨 Never use `cache_position` anymore in generation 🚨 [generate] Never use `cache_position` anymore in generation 162 days ago
Cyrilvallez update tests
327513ed
Cyrilvallez more tests
8083d6b0
zucchini-nlp
zucchini-nlp commented on 2026-03-18
Cyrilvallez fix
d64db4be
Cyrilvallez doc
cb5cc415
Cyrilvallez Merge branch 'main' into fully-remove-cache-pos-from-generate
0dd7cfd5
Cyrilvallez last changes
5cb41c5b
Cyrilvallez
github-actions
github-actions
huggingface huggingface deleted a comment from github-actions on 2026-03-18
Cyrilvallez Merge branch 'main' into fully-remove-cache-pos-from-generate
14ebd355
Cyrilvallez Merge branch 'main' into fully-remove-cache-pos-from-generate
0be14891
Cyrilvallez aqlm slipped through
4a639fd4
vasqu
vasqu commented on 2026-03-19
Cyrilvallez Cyrilvallez changed the title 🚨 [generate] Never use `cache_position` anymore in generation [generate] Never use `cache_position` anymore in generation 161 days ago
Cyrilvallez add bc for remote code models
a3b48dda
huggingface huggingface deleted a comment from github-actions on 2026-03-19
huggingface huggingface deleted a comment from github-actions on 2026-03-19
huggingface huggingface deleted a comment from github-actions on 2026-03-19
vasqu
vasqu approved these changes on 2026-03-19
zucchini-nlp
zucchini-nlp approved these changes on 2026-03-19
Cyrilvallez anton's review
ed56c9e8
Cyrilvallez add warning
0b6360ea
huggingface huggingface deleted a comment from github-actions on 2026-03-19
huggingface huggingface deleted a comment from github-actions on 2026-03-19
huggingface huggingface deleted a comment from github-actions on 2026-03-19
huggingface huggingface deleted a comment from github-actions on 2026-03-19
Cyrilvallez
github-actions
github-actions
Cyrilvallez Cyrilvallez merged 7805ec28 into main 161 days ago
Cyrilvallez Cyrilvallez deleted the fully-remove-cache-pos-from-generate branch 161 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone