vllm
[DP] Support api-server-count > 0 in hybrid DP LB mode
#21510

Merged

[DP] Support api-server-count > 0 in hybrid DP LB mode #21510

vllm-bot merged 1 commit into vllm-project:main from njhill:hybrid-api-scaleout

[DP] Support api-server-count > 0 in hybrid DP LB mode

26e55119

njhill requested a review from

robertgshaw2-redhat 1 year ago

njhill requested a review from

aarnphm 1 year ago

mergify added frontend

mergify added v1

gemini-code-assist commented on 2025-07-24

njhill added this to the v0.10.0 milestone 1 year ago

njhill added ready

tlrmchlsmth approved these changes on 2025-07-24

vllm-bot merged 9c8b2c2a into main 1 year ago

njhill deleted the hybrid-api-scaleout branch 1 year ago

Reviewers

tlrmchlsmth

gemini-code-assist

robertgshaw2-redhat

aarnphm

Assignees

No one assigned

Labels

frontend ready v1

Milestone

v0.10.0