vllm
[ROCm] Enable the cuMem CUDA-graph pool offload on ROCm
#59523

Open

[ROCm] Enable the cuMem CUDA-graph pool offload on ROCm #59523

aoshen02 wants to merge 3 commits into vllm-project:main from aoshen02:sleep-cumem-graph-pool-rocm

mergify added nvidia

mergify added rocm

mergify added mrv2

mergify added torch.compile

aoshen02 force pushed from fc9d1af3 to 5ec10b8b 4 days ago

aoshen02 force pushed from 5ec10b8b to 1c6815d4 4 days ago

aoshen02 force pushed from 1c6815d4 to 69e32b84 4 days ago

aoshen02 force pushed from 69e32b84 to da8b2250 4 days ago

aoshen02 force pushed from da8b2250 to 35f4cf8c 4 days ago

mergify added needs-rebase

aoshen02 force pushed from 35f4cf8c to 1ceae6db 3 days ago

mergify removed needs-rebase

aoshen02 force pushed from 1ceae6db to 890158f7 3 days ago

mergify added needs-rebase

aoshen02 force pushed from 890158f7 to 7d9eb6d9 3 days ago

mergify removed needs-rebase

aoshen02 force pushed from 7d9eb6d9 to aec5451f 3 days ago

aoshen02 force pushed from aec5451f to 71b96a1b 2 days ago

aoshen02 force pushed from 71b96a1b to 3a21bed8 2 days ago

aoshen02 force pushed from 3a21bed8 to d97a6011 2 days ago

aoshen02 force pushed from d97a6011 to e3c77aca 2 days ago

aoshen02 force pushed from e3c77aca to 89f30004 2 days ago

mergify added documentation

aoshen02 force pushed from 89f30004 to 744771ae 2 days ago

aoshen02 force pushed from 744771ae to 7680e501 2 days ago

aoshen02 force pushed from 7680e501 to c9ceda34 2 days ago

aoshen02 force pushed from c9ceda34 to 111751cb 2 days ago

aoshen02 force pushed from 111751cb to c68969e4 2 days ago

aoshen02 force pushed from c68969e4 to 4836ad12 2 days ago

aoshen02 force pushed from f88f8e30 to eb79dd16 2 days ago

aoshen02 force pushed from eb79dd16 to 68c987a5 2 days ago

aoshen02 force pushed from 68c987a5 to 12237a4b 2 days ago

aoshen02 force pushed from 12237a4b to dea93b58 2 days ago

aoshen02 force pushed from dea93b58 to 848c648a 2 days ago

aoshen02 force pushed from 848c648a to 6919ace3 2 days ago

aoshen02 force pushed from 6919ace3 to 27a2868d 2 days ago

mergify added needs-rebase

[ROCm] Enable the cuMem CUDA-graph pool offload on ROCm

30588e90

[ROCm] Pass register_graph_buffers to AiterCustomAllreduce

704c6ee7

[ROCm] Respect the graph-buffer policy in fused AITER all-reduce

82a5b697

aoshen02 force pushed from 27a2868d to 82a5b697 22 hours ago

mergify removed needs-rebase

Reviewers

No reviews

Assignees

No one assigned

Labels

documentation rocm torch.compile nvidia mrv2

Milestone

No milestone

vllm [ROCm] Enable the cuMem CUDA-graph pool offload on ROCm #59523 Open

[ROCm] Enable the cuMem CUDA-graph pool offload on ROCm #59523

vllm
[ROCm] Enable the cuMem CUDA-graph pool offload on ROCm
#59523

Open