init_method
#5706

Merged

Support SPMD through the xla:// init_method #5706

jonb377 merged 4 commits into master from jonbolin/dist-init

jonb377 requested a review from

yeounoh 2 years ago

jonb377 requested a review from

alanwaketan 2 years ago

jonb377 requested a review from

will-cromar 2 years ago

will-cromar commented on 2023-10-16

jonb377 force pushed from f0b7dc89 to 03a34d83 2 years ago

jonb377 marked this pull request as ready for review 2 years ago

alanwaketan commented on 2023-10-26

jonb377 force pushed from 03a34d83 to 0c1ee9fc 2 years ago

jonb377 force pushed from 0c1ee9fc to c4dead92 2 years ago

jonb377 commented on 2023-10-26

yeounoh commented on 2023-10-26

yeounoh approved these changes on 2023-10-26

Support SPMD through the xla:// init_method

15360200

Ensure compatibility with multithreading

13177fe3

Add get_master_ip to runtime

d4f2c8e2

Use for loop instead of iterator

00fc1869

jonb377 force pushed from c4dead92 to 00fc1869 2 years ago

jonb377 merged 1f0e972a into master 2 years ago

jonb377 deleted the jonbolin/dist-init branch 2 years ago

Reviewers

yeounoh

alanwaketan

will-cromar

Assignees

No one assigned

Labels

None yet

Milestone

No milestone