xla
Fix global_device_count(), local_device_count() for single process on CUDA
#6022

Merged

Fix global_device_count(), local_device_count() for single process on CUDA #6022

vanbasten23 merged 33 commits into master from fix_global_runtime_device_count

vanbasten23 requested a review from

will-cromar 2 years ago

vanbasten23 requested a review from

jonb377 2 years ago

jonb377 approved these changes on 2023-12-04

vanbasten23 requested a review from

yeounoh 2 years ago

jonb377 commented on 2023-12-06

vanbasten23 force pushed from 54bad352 to d0faac50 2 years ago

miladm commented on 2024-01-04

vanbasten23 added DO_NOT_REVIEW_YET

vanbasten23 changed the title ~~Fix xr.global_runtime_device_count for single process on CUDA~~ Fix global_device_count(), local_device_count for single process on CUDA 2 years ago

vanbasten23 force pushed from 3292787f to fe03a80e 2 years ago

will-cromar approved these changes on 2024-01-11

vanbasten23 force pushed from fe03a80e to b98ef935 2 years ago

vanbasten23 changed the title ~~Fix global_device_count(), local_device_count for single process on CUDA~~ Fix global_device_count(), local_device_count() for single process on CUDA 2 years ago

vanbasten23 force pushed from cbeabb87 to 6c2b64f7 2 years ago

vanbasten23 removed DO_NOT_REVIEW_YET

vanbasten23 requested a review from

jonb377 2 years ago

vanbasten23 requested a review from

will-cromar 2 years ago

will-cromar approved these changes on 2024-01-19

jonb377 commented on 2024-01-19

vanbasten23 force pushed from 5b18c955 to 922cbc11 2 years ago

will-cromar commented on 2024-01-26

vanbasten23 force pushed from 96aa381e to 3a60d9f9 2 years ago

vanbasten23 force pushed from 3a60d9f9 to f78dbc99 2 years ago

vanbasten23 force pushed from 1ca5f038 to a388cfa8 2 years ago

vanbasten23 force pushed from f0a8e41b to 960d6095 2 years ago

fixed it

36c9d3dc

added the test

e1164be1

remove prints

61d4cda7

fix up

a025c236

replace gpu with cuda

cb375241

fix up

93f1dc5a

trigger another ci

b6c58ca2

fix the test_runtime.py test so it runs for GPU as well.

d724f646

remove pdb

1dd42613

skip a test temperarily.

b39fbb23

Fix the test XLAShardingTest.CreateTensorsData

9a7b423a

skip another multithreading test for gpu

b90b3421

remove prints

ee243d03

remove more prints

3fa038f5

remove global_runtime_device_count test case

98232695

fix linter

b10570ba

fix the broken tests

18324772

fix a build issue

d590e30b

fix linter

4d74168a

fix build after pin update and a failing spmd test

b154538d

fix linter

6bfdf194

fix comments

c5e717eb

Incorporate the fix cl/601517680

0291311a

add comment to the patch and fix linter

3c774fe5

add a single processing gpu test.

862f7da0

add print in spmd tests. Local test works but fail in the CI

5d64007c

fix test and linter

d59457fc

clean up prints

e8e16979

clean up another prints

db3d0c85

fix linter

10e459be

fix BasicShardingTest.test_2d_tensor_3d_mesh on cpu

aee08dfa

vanbasten23 force pushed from 960d6095 to aee08dfa 2 years ago

jonb377 approved these changes on 2024-02-02

fix comments

b3991a7f

remove unwanted function

953d9b40

vanbasten23 merged 8fc8d57a into master 2 years ago

yeounoh commented on 2024-02-05

miladm assigned

vanbasten23 1 year ago

miladm added xla:gpu

Reviewers

jonb377

will-cromar

miladm

yeounoh

Assignees

vanbasten23

Labels

xla:gpu

Milestone

No milestone

xla Fix global_device_count(), local_device_count() for single process on CUDA #6022 Merged

Fix global_device_count(), local_device_count() for single process on CUDA #6022

xla
Fix global_device_count(), local_device_count() for single process on CUDA
#6022

Merged