transformers
9c8a1b83 - [fix] Add `fatal_error` to `ContinuousBatchingManager` so the serving layer can detect a dead CB worker (#45898)

Commit
78 days ago
[fix] Add `fatal_error` to `ContinuousBatchingManager` so the serving layer can detect a dead CB worker (#45898) * Add `fatal_error` to `ContinuousBatchingManager` so the serving layer can detect a dead CB worker * style * style fix * Update utils.py Co-authored-by: Rémi Ouazan <83456801+remi-or@users.noreply.github.com> --------- Co-authored-by: Rémi Ouazan <83456801+remi-or@users.noreply.github.com>
Author
Parents
Loading