PR #41446 Enable non-streaming mode in `transformers serve`

Enable non-streaming mode in `transformers serve` #41446

LysandreJik merged 3 commits into main from serving-lighteval

Base automatically changed from streaming-requests-cb to main 142 days ago

LysandreJik force pushed from 21cf126b to 5a99194c 142 days ago

LysandreJik marked this pull request as ready for review 138 days ago

github-actions requested a review from

ArthurZucker 138 days ago

github-actions requested a review from

Rocketknight1 138 days ago

Enable non-streaming in transformers serve

baf187d5

Fix tests

dca9e054

LysandreJik force pushed from af65c33a to dca9e054 138 days ago

ArthurZucker approved these changes on 2025-10-14

Arthur review

a0c6b40d

ArthurZucker approved these changes on 2025-10-14

LysandreJik merged 13a35a50 into main 137 days ago

LysandreJik deleted the serving-lighteval branch 137 days ago

Reviewers

ArthurZucker

Rocketknight1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone