vllm
4290b704 - [V1][PP] Do not block engine core when no requests to schedule (#14585)

Commit

1 year ago

[V1][PP] Do not block engine core when no requests to schedule (#14585) Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>

References

Author

comaniac

Parents