PR #5305 Supoort unordered sharding spec correctly

Supoort unordered sharding spec correctly #5305

JackCaoG merged 3 commits into master from JackCao/unordered_sharding_spec

Supoort non-ordered sharding spec correctly

6b8b8ece

JackCaoG added distributed

JackCaoG requested a review from

alanwaketan 2 years ago

JackCaoG requested a review from

jonb377 2 years ago

jonb377 approved these changes on 2023-07-13

alanwaketan approved these changes on 2023-07-13

use permute instead of transpose

9f92496a

JackCaoG requested a review from

alanwaketan 2 years ago

alanwaketan commented on 2023-07-13

use dim > 2 to suit TPU v3(otherwise can't be divide evenly)

3affe2a4

JackCaoG merged 67705065 into master 2 years ago

Reviewers

alanwaketan

jonb377

Assignees

No one assigned

Labels

distributed

Milestone

No milestone