xla
Make use_spmd to force SPMD mode for easier 3rd-party integration.
#6680

Merged

Make use_spmd to force SPMD mode for easier 3rd-party integration. #6680

yeounoh merged 6 commits into master from extensible_use_spmd_api

yeounoh added distributed

yeounoh assigned

yeounoh 2 years ago

yeounoh marked this pull request as draft 2 years ago

yeounoh changed the title ~~Make usr_spmd to force SPMD mode for easier 3rd-party integration.~~ Make use_spmd to force SPMD mode for easier 3rd-party integration. 2 years ago

yeounoh marked this pull request as ready for review 2 years ago

yeounoh requested a review from

alanwaketan 2 years ago

yeounoh requested a review from

jonb377 2 years ago

yeounoh requested a review from

JackCaoG 2 years ago

yeounoh force pushed from e7e13621 to e1e21f2f 2 years ago

yeounoh force pushed from e1e21f2f to 3ba01e25 2 years ago

yeounoh force pushed from 3ba01e25 to 20542325 2 years ago

yeounoh marked this pull request as draft 2 years ago

yeounoh added DO_NOT_MERGE_YET

yeounoh force pushed from ed1e624c to 9a11c697 2 years ago

yeounoh force pushed from 9a11c697 to 71b4471f 2 years ago

yeounoh force pushed from 71b4471f to 0072bbe9 2 years ago

yeounoh force pushed from 0072bbe9 to 3e70a3b9 2 years ago

yeounoh force pushed from 3e70a3b9 to e5ff6e47 2 years ago

yeounoh force pushed from e5ff6e47 to 4a5623a2 2 years ago

yeounoh force pushed from 4a5623a2 to 67287630 2 years ago

yeounoh force pushed from 67287630 to a8c41069 2 years ago

yeounoh force pushed from a8c41069 to 90cfbb5f 2 years ago

yeounoh marked this pull request as ready for review 2 years ago

yeounoh force pushed from 90cfbb5f to 1149efe0 2 years ago

yeounoh force pushed from 1149efe0 to 156cc98b 2 years ago

alanwaketan commented on 2024-03-07

jonb377 commented on 2024-03-07

yeounoh force pushed from 156cc98b to 9d023c82 2 years ago

yeounoh force pushed from 9d023c82 to 7df58177 2 years ago

yeounoh force pushed from 7df58177 to f46c9a76 2 years ago

yeounoh force pushed from f46c9a76 to 2b452825 2 years ago

yeounoh force pushed from 2b452825 to 6aba4f4f 2 years ago

yeounoh force pushed from 6aba4f4f to 1402d7db 2 years ago

yeounoh force pushed from 1402d7db to ac410eb5 2 years ago

yeounoh force pushed from ac410eb5 to f4fd7793 2 years ago

yeounoh force pushed from f4fd7793 to 7c7f0c77 2 years ago

yeounoh force pushed from 7c7f0c77 to aa59abd5 2 years ago

yeounoh force pushed from aa59abd5 to 3481b403 2 years ago

yeounoh force pushed from 3481b403 to f0a74c2f 2 years ago

yeounoh force pushed from f0a74c2f to e5cb0e18 2 years ago

yeounoh force pushed from e5cb0e18 to aa064146 2 years ago

yeounoh removed DO_NOT_MERGE_YET

alanwaketan approved these changes on 2024-03-08

yeounoh force pushed from b43f9b32 to 843d9d59 2 years ago

yeounoh force pushed from 3a298194 to 5974f956 2 years ago

yeounoh force pushed from 1206b875 to 71b4206d 2 years ago

yeounoh force pushed from 71b4206d to 427abe90 2 years ago

yeounoh force pushed from 427abe90 to 292dbf9c 2 years ago

Make usr_spmd to force SPMD mode for easier 3rd-party integration.

9af4ad73

Implement _XLAC._xla_get_device_hw_type(const at::Tensor&) to check X…

17884d1e

revert settings.json change

0e611baf

Update UseVirtualDevice to call ShouldUseVirtualDevice to check XLA_U…

7bac07e4

Run in SPMD mode if UseVirtualDevice() is true

64deb62b

yeounoh force pushed from 292dbf9c to 64deb62b 2 years ago

JackCaoG commented on 2024-03-08

jonb377 commented on 2024-03-08

JackCaoG commented on 2024-03-08

JackCaoG approved these changes on 2024-03-08

yeounoh force pushed from 79cae62c to 5cbe22b3 2 years ago

yeounoh force pushed from 5cbe22b3 to 831ed44c 2 years ago

yeounoh force pushed from 831ed44c to 1029cca2 2 years ago

yeounoh force pushed from 1029cca2 to 2eda9959 2 years ago

Refactoring

16376c27

yeounoh force pushed from 2eda9959 to 16376c27 2 years ago

yeounoh merged f3a2e243 into master 2 years ago

Reviewers

JackCaoG

alanwaketan

jonb377

Assignees

yeounoh

Labels

distributed

Milestone

No milestone

xla Make use_spmd to force SPMD mode for easier 3rd-party integration. #6680 Merged

Make use_spmd to force SPMD mode for easier 3rd-party integration. #6680

xla
Make use_spmd to force SPMD mode for easier 3rd-party integration.
#6680

Merged