vllm
b53b89fd - [BugFix] Async scheduling: handle model forward errors more cleanly (#31611)

Commit

105 days ago

[BugFix] Async scheduling: handle model forward errors more cleanly (#31611) Signed-off-by: njhill <nickhill123@gmail.com>

References

Author

njhill

Parents