transformers
[generate] Always pass full input_ids in `prepare_inputs_for_generation`
#44226

Merged

[generate] Always pass full input_ids in `prepare_inputs_for_generation` #44226

Cyrilvallez merged 14 commits into main from send-full-inputs

Cyrilvallez force pushed from 74727d9c to 766a86ed 102 days ago

zucchini-nlp commented on 2026-02-23

zucchini-nlp approved these changes on 2026-02-24

send full input_ids, slice after

8dac28e2

fix xlm

46586c55

fix

79c9c9e9

improve

41a565db

fix

dc037017

make sure

b66b1a7b

finally get it... they are modified in-place and clone was saving us...

4817b5e6

all the same

2a4672b6

fix

5e603582

fix

9bcfb813

finally

f9dccdf1

doc

a5b1c128

higgs

ac30867d

Cyrilvallez force pushed from 8b4e2ae4 to ac30867d 101 days ago

vasqu approved these changes on 2026-02-24

add comment

cfdf7c0a

Cyrilvallez merged 3c52b78a into main 101 days ago

Cyrilvallez deleted the send-full-inputs branch 101 days ago

Reviewers

vasqu

zucchini-nlp

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers [generate] Always pass full input_ids in `prepare_inputs_for_generation` #44226 Merged

[generate] Always pass full input_ids in `prepare_inputs_for_generation` #44226

transformers
[generate] Always pass full input_ids in `prepare_inputs_for_generation`
#44226

Merged