vllm
[Feature] Add --rank-tp-ratio for uneven tensor parallelism on mismatched GPUs
#50735
Closed
Closed
[Feature] Add --rank-tp-ratio for uneven tensor parallelism on mismatched GPUs #50735
efschu
wants to merge
2 commits into
vllm-project:main
from
efschu:pr/uneven-tp
[Feature] Add --rank-gpu-id / --rank-gpu-memory-mib for heterogeneous…
8cde7e6a
[Feature] Add --rank-tp-ratio for uneven tensor parallelism on mismat…
158cb53d
claude
commented
on 2026-08-02
Reviewers
Assignees
No one assigned
Labels
qwen
nvidia
Milestone
No milestone
Login to write a write a comment.
Login via GitHub