vllm
[Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1
#17827
Merged
Overview
Commits
10
Changes
View On GitHub

[Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 #17827

simon-mo merged 10 commits into vllm-project:main from luccafong:torch_run_pp
luccafong
github-actions
mergify mergify added documentation
mergify mergify added v1
luccafong luccafong marked this pull request as ready for review 1 year ago
luccafong luccafong requested a review from WoosukKwon WoosukKwon 1 year ago
luccafong luccafong requested a review from robertgshaw2-redhat robertgshaw2-redhat 1 year ago
luccafong luccafong requested a review from njhill njhill 1 year ago
luccafong luccafong requested a review from ywang96 ywang96 1 year ago
luccafong luccafong requested a review from comaniac comaniac 1 year ago
luccafong luccafong requested a review from alexm-redhat alexm-redhat 1 year ago
luccafong luccafong changed the title Support Pipeline Parallism in torchrun SPMD offline inference for V1 [Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 1 year ago
luccafong luccafong requested a review from youkaichao youkaichao 1 year ago
houseroad
houseroad commented on 2025-05-09
comaniac
comaniac commented on 2025-05-09
youkaichao
youkaichao commented on 2025-05-10
houseroad
houseroad commented on 2025-05-12
mergify
mergify mergify added needs-rebase
luccafong Support Pipeline Parallism in torchrun SPMD offline inference
d7d60715
luccafong format
e4d66717
luccafong remove config pipeline_parallel_broadcast_output
1c956261
luccafong fix backend type
157c7475
luccafong luccafong force pushed to 157c7475 1 year ago
mergify mergify removed needs-rebase
luccafong
houseroad houseroad added ready
houseroad
houseroad approved these changes on 2025-05-12
luccafong fix ray path
0a4da1df
luccafong fix assertion
dca6e00d
ruisearch42
ruisearch42 commented on 2025-05-12
luccafong add test case for PP torchrun
f4e29f3a
mergify mergify added ci/build
luccafong Merge remote-tracking branch 'origin/main' into torch_run_pp
9472df97
luccafong fix test example
352404e7
mergify
mergify mergify added needs-rebase
luccafong Merge remote-tracking branch 'origin/main' into torch_run_pp
0546258b
mergify mergify removed needs-rebase
DarkLight1337 DarkLight1337 added this to the v0.9.0 milestone 1 year ago
luccafong
houseroad
luccafong
houseroad houseroad enabled auto-merge (squash) 1 year ago
disabled auto-merge 1 year ago
Manually disabled by user
simon-mo simon-mo merged 3d2779c2 into main 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
documentation ready ci/build v1
Milestone
v0.9.0
Terms Of Use Privacy Policy Refund Policy Impressum