DeepSpeed
Warn when zero.Init silently falls back to a single rank (#8084)
#8089
Merged

Warn when zero.Init silently falls back to a single rank (#8084) #8089

akshansh47
akshansh47 akshansh47 requested a review from tjruwase tjruwase 128 days ago
akshansh47 akshansh47 requested a review from tohtana tohtana 128 days ago
akshansh47 akshansh47 requested a review from loadams loadams 128 days ago
chatgpt-codex-connector
akshansh47 Warn when zero.Init silently falls back to a single rank (#8084)
642a9d28
akshansh47 akshansh47 force pushed from 34c5b28d to 642a9d28 127 days ago
sfc-gh-truwase
akshansh47
sfc-gh-truwase
sfc-gh-truwase
akshansh47 Escalate zero.Init single-rank PG contradiction from warning to error
7abdeb98
akshansh47
sfc-gh-truwase
sfc-gh-truwase commented on 2026-07-16
sfc-gh-truwase Merge branch 'master' into fix/zero-init-unsharded-single-rank-warning
3ee55b03
tohtana
akshansh47 Merge branch 'master' into fix/zero-init-unsharded-single-rank-warning
3e76af0a
akshansh47 Treat deprecated sequence_data_parallel_group as an explicit group in…
70b61a0d
akshansh47
tohtana
akshansh47 Move PG-contradiction test to tests/unit/v1/zero, DeepSpeed Team head…
0c3aa091
akshansh47
tohtana
tohtana approved these changes on 2026-07-30
tjruwase
tjruwase approved these changes on 2026-07-31
sfc-gh-truwase sfc-gh-truwase merged a375b7f1 into master 91 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone