vllm
use the same stream for cuda graph catpure and replay for NCCL
#29207

Merged

use the same stream for cuda graph catpure and replay for NCCL #29207

youkaichao merged 13 commits into vllm-project:main from Amir-19:pynccl_symm_fix

add stream to cuda graph catpure

28579b55

Amir-19 requested a review from

zou3519 41 days ago

Amir-19 requested a review from

youkaichao 41 days ago

Amir-19 requested a review from

ProExpertProg 41 days ago

mergify added performance

mergify added nvidia

gemini-code-assist commented on 2025-11-21

ProExpertProg added ready

wip

695d78c4

mergify added v1

wip

dfb5ce44

wip

d1f2b3b9

BoyuanFeng commented on 2025-11-25

Merge branch 'main' into pynccl_symm_fix

f5f1ab26

Merge branch 'main' into pynccl_symm_fix

aeac905e

Merge branch 'main' into pynccl_symm_fix

2d9628c4

Amir-19 changed the title ~~[do not merge yet] add stream to cuda graph catpure~~ add stream to cuda graph catpure 31 days ago

Amir-19 requested a review from

BoyuanFeng 28 days ago

zou3519 commented on 2025-12-05

BoyuanFeng commented on 2025-12-06

Amir-19 requested a review from

zou3519 26 days ago

Amir-19 requested a review from

BoyuanFeng 26 days ago

youkaichao approved these changes on 2025-12-24

Merge branch 'main' into pynccl_symm_fix

fd593c59

update default stream for cuda

73094c75

typo fix

790fe091

update tests

95e96f09

use vllm current stream

208a8820

revert some test changes

f5d378b5

youkaichao changed the title ~~add stream to cuda graph catpure~~ use the same stream for cuda graph catpure and replay for NCCL 7 days ago

youkaichao merged 030fc449 into main 7 days ago

Reviewers

youkaichao

zou3519

BoyuanFeng

gemini-code-assist

ProExpertProg

Assignees

No one assigned

Labels

performance ready v1 nvidia

Milestone

No milestone

vllm use the same stream for cuda graph catpure and replay for NCCL #29207 Merged

use the same stream for cuda graph catpure and replay for NCCL #29207

vllm
use the same stream for cuda graph catpure and replay for NCCL
#29207

Merged