PR #40652 🔴 Isolate prefill from generation loops

🔴 Isolate prefill from generation loops #40652

gante merged 4 commits into huggingface:main from manueldeprada:isolate-prefill

manueldeprada commented on 2025-09-04

manueldeprada changed the title ~~Isolate prefill~~ 🔴 Isolate prefill from generation loops 102 days ago

manueldeprada commented on 2025-09-04

gante commented on 2025-09-05

manueldeprada requested a review from

gante 92 days ago

isolate-prefill: squash

44274e61

manueldeprada force pushed from 53853591 to 44274e61 91 days ago

gante commented on 2025-09-19

Merge branch 'main' of github.com:huggingface/transformers into isola…

2d68770d

prefill inside decoding methods

a77a50d4

simplify autocompile helpers

3cb293e1

manueldeprada marked this pull request as ready for review 41 days ago

manueldeprada requested a review from

gante 41 days ago

gante approved these changes on 2025-11-05

gante merged 571352d3 into main 40 days ago

Reviewers

gante

Assignees

No one assigned

Labels

None yet

Milestone

No milestone