PR #5002 Enable SPMD + dynamo for inference

Enable SPMD + dynamo for inference #5002

JackCaoG merged 5 commits into master from JackCaoG/dynamo_spmd

initial code change

24176430

Add simple test, which currently failed

81850656

JackCaoG added distributed

JackCaoG added dynamo

yeounoh requested a review from

yeounoh 2 years ago

Add try catch to dynamo, use SPMD device in dynamo, create sharded pl…

89113ca0

JackCaoG commented on 2023-05-16

JackCaoG marked this pull request as ready for review 2 years ago

JackCaoG changed the title ~~[WIP] Enable SPMD + dynamo for inference~~ Enable SPMD + dynamo for inference 2 years ago

JackCaoG requested a review from

alanwaketan 2 years ago

JackCaoG requested a review from

wonjoo-wj 2 years ago

JackCaoG requested a review from

jonb377 2 years ago

JackCaoG commented on 2023-05-16

alanwaketan approved these changes on 2023-05-16

fix review comments

e47acfa8

JackCaoG requested a review from

alanwaketan 2 years ago

jonb377 approved these changes on 2023-05-17

alanwaketan approved these changes on 2023-05-17

yeounoh commented on 2023-05-17

change comments

2a8cc734

JackCaoG merged dc057dcd into master 2 years ago

Reviewers

alanwaketan

jonb377

yeounoh

wonjoo-wj

Assignees

No one assigned

Labels

distributed dynamo

Milestone

No milestone