vllm
perf: add push-based allreduce for small tensor reductions
#44891

Open

perf: add push-based allreduce for small tensor reductions #44891

alexm-redhat wants to merge 9 commits into main from perf/push-allreduce-2buffer

alexm-redhat requested a review from

tlrmchlsmth 36 days ago

alexm-redhat requested a review from

LucasWilkinson 36 days ago

alexm-redhat requested a review from

Harry-Chen 36 days ago

claude commented on 2026-06-08

mergify added ci/build

mergify added nvidia

mergify added needs-rebase

alexm-redhat assigned

alexm-redhat 36 days ago

github-advanced-security commented on 2026-06-08

depthfirst-app commented on 2026-06-08

ilmarkov commented on 2026-06-10

alexm-redhat force pushed from 297ba8e4 to 6d32045b 28 days ago

alexm-redhat force pushed from 6d32045b to 7e7e30ce 28 days ago

mergify added performance

perf: add push-based allreduce for small tensor reductions

5fd9bd4f

Address review: add CUDA error checking and runtime buffer overflow g…

c55216eb

Address review: bind test sockets to localhost instead of all interfaces

e0601e1b

Address review: add type annotation and cleanup for push_ar_comm

54b43935

Address review: add architecture-specific threshold selection

17488a74

Address review: register VLLM_DISABLE_PUSH_ALLREDUCE in envs.py

625bea39

Address review: use registered envs.VLLM_DISABLE_PUSH_ALLREDUCE

bc50e5fc

Address review: add push_ar to benchmark and backend logging

fd44100b

alexm-redhat force pushed from b8332645 to fd44100b 28 days ago

Apply pre-commit formatting and use torch.accelerator API

fa6b6a83

mergify removed needs-rebase

mergify added needs-rebase

Reviewers

depthfirst-app

claude

ilmarkov

github-advanced-security

tlrmchlsmth

LucasWilkinson

Harry-Chen

Assignees

alexm-redhat

Labels

performance needs-rebase ci/build nvidia

Milestone

No milestone

vllm perf: add push-based allreduce for small tensor reductions #44891 Open

perf: add push-based allreduce for small tensor reductions #44891

vllm
perf: add push-based allreduce for small tensor reductions
#44891

Open