DeepSpeed
[Bugfix] Resolve Rank index out of range during BWD when sp_size < world_size in Ulysses
#7809

Merged

[Bugfix] Resolve Rank index out of range during BWD when sp_size < world_size in Ulysses #7809

tohtana merged 4 commits into deepspeedai:master from Flink-ddd:fix/issue-7672-ulysses-sp-backward-stability

Flink-ddd requested a review from

tjruwase 42 days ago

Flink-ddd requested a review from

loadams 42 days ago

Flink-ddd requested a review from

tohtana 42 days ago

fix: Rank index out of range during BWD when sp_size < world_size

4dc78466

Flink-ddd force pushed from 2b386ab3 to 4dc78466 42 days ago

Add legacy PyTorch warning with link and doc note for SP

b555aa53

tohtana commented on 2026-01-27

Use required_torch_version utility for version check

5b1d8542

Merge branch 'master' into fix/issue-7672-ulysses-sp-backward-stability

2e06a04d

tohtana enabled auto-merge (squash) 37 days ago

Flink-ddd requested a review from

tohtana 37 days ago

tohtana approved these changes on 2026-01-28

tohtana merged bb250a25 into master 37 days ago

Reviewers

tohtana

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone