TPU Pod support with PjRt #3813
will-cromar
marked this pull request as ready for review 3 years ago
Configure TPU topology for pods
5fb8b20f
Use metadata for network endpoints
5d1a67e7
Add TPU tests
653d7575
Fix computing num local processes.
fb5155f2
Add unit tests for tpu.py
22706096
Remove unused imports
0ef59d0f
formatting
cf64ce33
Don't use metadata for process bounds on v3
00c50cb1
Fix real device indices for v3
c902cc6e
Add TPU unit test to run_tests.sh
792e03c9
Update docstrings
43c64630
Fix signatures of `num_processes` and `num_local_processes`.
57b9b0b2
Make MeshShape more pythonic
2ea3017e
Clarify naming of `num_processes`
3ce02c7c
Don't try to get TPU task id on CPU
5747bd1c
Don't use value of `mock.patch.dict` because CI uses 3.7
215c9c5e
will-cromar
force pushed
from
4b9e2e5b
to
215c9c5e
3 years ago
Remove real devices test
c392ce36
Address review comments
695e5df4
fix docstring
d2272cd0
JackCaoG
approved these changes
on 2022-08-12
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub