PR #38949 Allow `device_mesh` have multiple dim

Allow `device_mesh` have multiple dim #38949

SunMarc merged 8 commits into main from fsdp2-tp

Feat: something

4dd497fc

Feat: initial changes

08f54bbe

tmp changes to unblock

f84ecc45

winglian approved these changes on 2025-07-22

winglian commented on 2025-07-22

Refactor

17d2d695

remove todo

56d2c9e2

Merge branch 'main' into fsdp2-tp

622e9b97

S1ro1 marked this pull request as ready for review 176 days ago

Feat: docstring

b35ac20a

SunMarc approved these changes on 2025-07-23

SunMarc changed the title ~~[WIP] FSDP2 + TP + (other)~~ Allow `device_mesh` have multiple dim 176 days ago

Merge branch 'main' into fsdp2-tp

33e28196

SunMarc enabled auto-merge (squash) 176 days ago

SunMarc merged 82603b6c into main 176 days ago

SunMarc deleted the fsdp2-tp branch 176 days ago

S1ro1 restored the head branch 173 days ago

Reviewers

SunMarc

winglian

Assignees

No one assigned

Labels

None yet

Milestone

No milestone