DeepSpeed
[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism
#8167

Merged

[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism #8167

delock merged 4 commits into deepspeedai:master from delock:gma/allow-autotp-with-zero3

delock requested a review from

tjruwase 19 days ago

delock requested a review from

tohtana 19 days ago

delock requested a review from

loadams 19 days ago

chatgpt-codex-connector commented on 2026-07-23

[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism

2e4247e1

delock force pushed from cf7ae19e to 2e4247e1 19 days ago

delock changed the title ~~[AutoTP] Allow ZeRO stage 3 with tensor parallelism~~ [AutoTP] Allow ZeRO stage 3 inference with tensor parallelism 19 days ago

Merge branch 'master' into gma/allow-autotp-with-zero3

d74737e0

sfc-gh-truwase commented on 2026-07-23

sfc-gh-truwase approved these changes on 2026-07-23

remove redudant comments

5ec52721

PKUWZP approved these changes on 2026-07-24

delock enabled auto-merge 18 days ago

Merge branch 'master' into gma/allow-autotp-with-zero3

ef32022c

delock merged d3265209 into master 18 days ago

delock deleted the gma/allow-autotp-with-zero3 branch 18 days ago

Reviewers

PKUWZP

sfc-gh-truwase

chatgpt-codex-connector

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed [AutoTP] Allow ZeRO stage 3 inference with tensor parallelism #8167 Merged

[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism #8167

DeepSpeed
[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism
#8167

Merged