transformers
Prefill-related logic in input preparation for generation
#42088
Merged
Overview
Commits
30
Changes
View On GitHub

Prefill-related logic in input preparation for generation #42088

zucchini-nlp merged 30 commits into huggingface:main from zucchini-nlp:prefill-logic
zucchini-nlp
zucchini-nlp add prefill arg in generation
77f4b608
HuggingFaceDocBuilderDev
zucchini-nlp add a slow test
423a9cb8
zucchini-nlp fix copies
0f659bb5
zucchini-nlp
zucchini-nlp can be like this but checking special tokens isn't good
906f88c6
manueldeprada
zucchini-nlp
zucchini-nlp ig this solves the issue with assisted_gen+prefill
5a918de8
zucchini-nlp update overwritten `prepare_inpits_for_generation`
ef04c518
zucchini-nlp prefill is actually when we have no cache at all.. Try this for now
00e4814e
zucchini-nlp
zucchini-nlp first iteration is not always techincally same as prefill
6338d174
zucchini-nlp fix?
72916075
zucchini-nlp fix now?
32e54658
zucchini-nlp update bloom
375ad90e
zucchini-nlp fix smth
a184c8bb
zucchini-nlp make style
79abb96e
zucchini-nlp fix copies and skip test
36c60529
zucchini-nlp Merge branch 'main' into prefill-logic
1ff4e23e
zucchini-nlp Merge branch 'main' into prefill-logic
d4d99cb8
zucchini-nlp zucchini-nlp changed the title [WIP] Prefill-related logic in input preparation for generation Prefill-related logic in input preparation for generation 209 days ago
zucchini-nlp
github-actions
zucchini-nlp
zucchini-nlp commented on 2025-11-19
zucchini-nlp
zucchini-nlp commented on 2025-11-19
zucchini-nlp fix copies
939e58dc
zucchini-nlp zucchini-nlp requested a review from vasqu vasqu 209 days ago
vasqu
vasqu commented on 2025-11-19
zucchini-nlp tiny updates after a review
820cc920
zucchini-nlp
github-actions
github-actions
zucchini-nlp fix other slow tests
597b1879
zucchini-nlp merge main
406bdb32
zucchini-nlp fix copies
39fb07ab
zucchini-nlp do not pass the same kwargs twice in prefill
cf1486c6
zucchini-nlp oops
1dc9cc2e
zucchini-nlp Merge branch 'main' into prefill-logic
2a44715c
zucchini-nlp have to revert? prob fails only on dgx
c82f5381
zucchini-nlp zucchini-nlp requested a review from vasqu vasqu 193 days ago
zucchini-nlp
zucchini-nlp
github-actions
github-actions
zucchini-nlp adjust slow test again
d156e10d
vasqu
vasqu approved these changes on 2025-12-05
zucchini-nlp Merge branch 'main' into prefill-logic
b15723c2
zucchini-nlp
github-actions
zucchini-nlp address comments
028d2eb7
github-actions
zucchini-nlp
vasqu
zucchini-nlp Merge branch 'main' into prefill-logic
a0a2ac7a
zucchini-nlp
github-actions
zucchini-nlp fix copies
ba023d0f
github-actions
zucchini-nlp zucchini-nlp merged ccc7d90b into main 175 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum