PR #44436 Fix continuous batching for multimodal models

Fix continuous batching for multimodal models #44436

remi-or merged 5 commits into huggingface:main from jw9603:fix-continuous-batching-tokenize

Fix continuous batching for multimodal models

ffa676af

zucchini-nlp commented on 2026-03-04

Add continuous batching test for VLM

68ed6a43

remi-or commented on 2026-03-05

jw9603 requested a review from

remi-or 31 days ago

jw9603 requested a review from

zucchini-nlp 31 days ago

Fall back to regular generate for non-text-only models

007e4e18

Add warning when falling back from continuous batching

6decf8f1

remi-or approved these changes on 2026-03-09

Merge branch 'main' into fix-continuous-batching-tokenize

9f0a70e9

remi-or merged 70ca366f into main 27 days ago

jw9603 deleted the fix-continuous-batching-tokenize branch 27 days ago

Reviewers

remi-or

zucchini-nlp

Assignees

No one assigned

Labels

None yet

Milestone

No milestone