vllm
edd270bc - [Bugfix] Prevent IndexError for cached requests when pipeline parallelism is disabled (#20486)

Commit
215 days ago
[Bugfix] Prevent IndexError for cached requests when pipeline parallelism is disabled (#20486) Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Author
Parents
Loading