DeepSpeed
Reuse continuous rollout graphs and release captured resources on shutdown
#9009

Merged

Reuse continuous rollout graphs and release captured resources on shutdown #9009

delock merged 4 commits into deepspeedai:master from jinyouzhi:perf/rollout-graph-lifecycle

jinyouzhi marked this pull request as ready for review 6 days ago

jinyouzhi requested a review from

tjruwase 6 days ago

jinyouzhi requested a review from

tohtana 6 days ago

jinyouzhi requested a review from

loadams 6 days ago

delock requested a review from

delock 5 days ago

tohtana added needs-gpu-test

jinyouzhi force pushed from dedd6c84 to 2313079f 2 days ago

delock approved these changes on 2026-11-13

delock merged f94aa5c5 into master 2 days ago

remove prompt_len from graph signature to keep batch continuous

8af5ed34

Document continuous graph reuse and shutdown ordering

c1854174

Include parameter layout in continuous graph signature

ae13113b

Include buffers in continuous graph signature

2313079f

tohtana removed needs-gpu-test

Reviewers

delock

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone