xla
[PjRt] Implement `xm.rendezvous` for TPU v4.
#3929

Merged

[PjRt] Implement `xm.rendezvous` for TPU v4. #3929

JackCaoG merged 5 commits into master from pjrt-mesh-server

will-cromar requested a review from

JackCaoG 3 years ago

will-cromar changed the title ~~Implement `xm.rendezvous` for TPU v4.~~ [PjRt] Implement `xm.rendezvous` for TPU v4. 3 years ago

will-cromar added runtime

will-cromar force pushed from b52569a0 to 5e81d90e 3 years ago

JackCaoG commented on 2022-08-25

Implement `xm.rendezvous` for TPU v4.

66dda769

Set default for torch.distributed in PJRT test.

538b85f1

Add mesh_reduce back to model tests.

0b507da6

Initialize process group with file if world size is 1.

2bf53331

Take mesh reduce back out of model tests because it will break v3.

0a98638b

will-cromar force pushed from 1fdf5a58 to 0a98638b 3 years ago

JackCaoG approved these changes on 2022-08-26

JackCaoG merged 5a09efdf into master 3 years ago

Reviewers

JackCaoG

Assignees

No one assigned

Labels

runtime

Milestone

No milestone