transformers
[fix] Add `fatal_error` to `ContinuousBatchingManager` so the serving layer can detect a dead CB worker
#45898
Merged

[fix] Add `fatal_error` to `ContinuousBatchingManager` so the serving layer can detect a dead CB worker #45898

ArthurZucker merged 4 commits into main from cb_fatal_error
qgallouedec
qgallouedec Add `fatal_error` to `ContinuousBatchingManager` so the serving layer…
5e9de6bb
qgallouedec style
11110492
qgallouedec style fix
d3776822
qgallouedec
qgallouedec commented on 2026-05-11
HuggingFaceDocBuilderDev
qgallouedec qgallouedec requested a review from SunMarc SunMarc 189 days ago
qgallouedec qgallouedec requested a review from remi-or remi-or 189 days ago
qgallouedec qgallouedec changed the title Add `fatal_error` to `ContinuousBatchingManager` so the serving layer can detect a dead CB worker [fix] Add `fatal_error` to `ContinuousBatchingManager` so the serving layer can detect a dead CB worker 189 days ago
remi-or
remi-or approved these changes on 2026-05-12
qgallouedec Update utils.py
5eb7dd76
qgallouedec
ArthurZucker
ArthurZucker approved these changes on 2026-05-13
ArthurZucker ArthurZucker merged 9c8a1b83 into main 188 days ago
ArthurZucker ArthurZucker deleted the cb_fatal_error branch 188 days ago
ArthurZucker ArthurZucker added for patch

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone