PR #7580 [torch_xla2] Functional collectives

[torch_xla2] Functional collectives #7580

qihqi merged 8 commits into master from wcromar/func-collectives

will-cromar force pushed from 3b9f88fc to 18a8cd27 1 year ago

will-cromar changed the base branch from master to wcromar/distributed 1 year ago

qihqi commented on 2024-06-26

Initial implementation of functional allreduce

8400d812

functional broadcast and all_gather

376cedd6

will-cromar force pushed from 55a6ee5a to 376cedd6 1 year ago

will-cromar changed the base branch from wcromar/distributed to master 1 year ago

Implement PG functions with dispatchable ops

879207f5

remove pg from tests that don't use it

28fc1ccf

handle async tensors in dispatcher

5fa07d4a

explain wait

2ce6428f

new file for c10d

59aade05

cleanup

d76a8824

will-cromar marked this pull request as ready for review 1 year ago

will-cromar requested a review from

qihqi 1 year ago

qihqi approved these changes on 2024-07-09

qihqi merged 3078d163 into master 1 year ago

ManfeiBai added torchxla2-op

ManfeiBai removed torchxla2-op

Reviewers

qihqi

Assignees

No one assigned

Labels

None yet

Milestone

No milestone