DeepSpeed
Support dynamic parameter offload for ZeRO-3 inference
#8468

Open

Support dynamic parameter offload for ZeRO-3 inference #8468

zupengwang wants to merge 1 commit into deepspeedai:master from zupengwang:feat/zero3-inference-state-offload

Support dynamic parameter offload for ZeRO-3 inference

97e1f865

zupengwang marked this pull request as ready for review 3 days ago

zupengwang requested a review from

tjruwase 3 days ago

zupengwang requested a review from

tohtana 3 days ago

zupengwang requested a review from

loadams 3 days ago

chatgpt-codex-connector commented on 2026-09-10

Reviewers

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone