xla
[FSDPv2] Shard on the maximal dim of weights
#7134

Merged

[FSDPv2] Shard on the maximal dim of weights #7134

alanwaketan merged 2 commits into master from alanwaketan/fsdp_maximal

alanwaketan added tpuci

alanwaketan requested a review from

jonb377 2 years ago

alanwaketan requested a review from

JackCaoG 2 years ago

alanwaketan assigned

alanwaketan 2 years ago

initial commit

082b0e6a

Fix litners

9dd39ccb

JackCaoG commented on 2024-05-29

alanwaketan force pushed from 701277f0 to 9dd39ccb 2 years ago

JackCaoG approved these changes on 2024-05-29

alanwaketan merged 15fc0f1c into master 2 years ago

alanwaketan deleted the alanwaketan/fsdp_maximal branch 2 years ago

Reviewers

JackCaoG

jonb377

Assignees

alanwaketan

Labels

None yet

Milestone

No milestone