PR #4905 [Distributed] Remove sea-of-devices mode

[Distributed] Remove sea-of-devices mode #4905

alanwaketan merged 9 commits into master from alanwaketan/cc

Remove sea of devices in all_reduce

5da034e4

Remove interhost allreduce

0d217d19

Remove _torch_all_reduce

fc9866f7

Remove CollectiveContext in reduce_gradients

8322f08e

Remove CollectiveContext

9d845b77

Further remove sea of devices

ea3088e4

alanwaketan requested a review from

JackCaoG 2 years ago

alanwaketan assigned

alanwaketan 2 years ago

Clean up even more

2ee39008

JackCaoG approved these changes on 2023-04-19

Fix linters

f4cb6ac7

Fix XlaBackendTest

721dd362

alanwaketan merged 397ea4d5 into master 2 years ago

Reviewers

JackCaoG

Assignees

alanwaketan

Labels

None yet

Milestone

No milestone