transformers
Wait for the first request in the async continuous batching bootstrap
#48304
Merged
Merged
Wait for the first request in the async continuous batching bootstrap #48304
remi-or
merged
9 commits into
main
from
fix-cb-bootstrap-wait
Wait for the first request in the async continuous batching bootstrap…
1b6a1a62
Merge branch 'main' into fix-cb-bootstrap-wait
f9c2c093
Trim comment
00f555af
qgallouedec
changed the title
Merge branch 'fix-cb-bootstrap-wait' of https://github.com/huggingfac…
e2e55eef
Merge branch 'main' into fix-cb-bootstrap-wait
c1eede5a
Merge branch 'main' into fix-cb-bootstrap-wait
699028fd
Reduce the amount of duplicate code
3eb6d16e
Style
5b996b46
remi-or
approved these changes
on 2026-08-27
Merge branch 'main' into fix-cb-bootstrap-wait
82871415
Login to write a write a comment.
Login via GitHub