vllm
[PerfFix] Avoid separate thread for MP executor shm spin
#28012

Merged

[PerfFix] Avoid separate thread for MP executor shm spin #28012

njhill merged 6 commits into vllm-project:main from njhill:nonblock-execmodel

njhill requested a review from

NickLucche 355 days ago

njhill requested a review from

ApostaC 355 days ago

njhill added this to the v0.11.1 milestone 355 days ago

mergify added v1

mergify added kv-connector

gemini-code-assist commented on 2025-11-04

chatgpt-codex-connector commented on 2025-11-04

njhill added ready

[PerfFix] Avoid separate thread for MP executor shm spin

3c65afeb

njhill force pushed to 3c65afeb 355 days ago

fix ray FutureWrapper change

fc503460

fix output aggregator test

45c6b36c

guard against cancellation in FutureWrapper

84cc1fa4

njhill force pushed to 84cc1fa4 355 days ago

fix ray future return

817c5255

mgoin approved these changes on 2025-11-04

Merge branch 'main' into nonblock-execmodel

fe0877d6

njhill merged c9f66da8 into main 354 days ago

njhill deleted the nonblock-execmodel branch 354 days ago

Reviewers

mgoin

gemini-code-assist

NickLucche

ApostaC

Assignees

No one assigned

Labels

ready v1 kv-connector

Milestone

v0.11.1