DeepSpeed
Add simple layout for creating multi-dimensional parallelism
#4706

Open

Add simple layout for creating multi-dimensional parallelism #4706

RezaYazdaniAminabadi wants to merge 2 commits into master from add-comm-layout

add simple layout for creating multi-dimensional parallelism

ba2c5fdc

RezaYazdaniAminabadi requested a review from

awan-10 2 years ago

RezaYazdaniAminabadi marked this pull request as draft 2 years ago

refactor layout

75f81ca9

Reviewers

awan-10

Assignees

No one assigned

Labels

None yet

Milestone

No milestone