xla
[Distributed] Move the cached all reduce token to C++
#4912

Merged

[Distributed] Move the cached all reduce token to C++ #4912

alanwaketan merged 12 commits into master from alanwaketan/token

alanwaketan assigned

alanwaketan 2 years ago

alanwaketan marked this pull request as draft 2 years ago

alanwaketan changed the base branch from master to alanwaketan/cc 2 years ago

alanwaketan changed the base branch from alanwaketan/cc to master 2 years ago

alanwaketan force pushed from b96e1ac0 to 54972451 2 years ago

alanwaketan marked this pull request as ready for review 2 years ago

alanwaketan requested a review from

JackCaoG 2 years ago

Introduce GetAllReduceToken

51869fc9

Introduce ResetAllReduceToken

2f753d69

introduce pybinds

e814d60a

introduce _set_all_reduce_token

a0c808fb

Remove token from python

3ca03eac

Remove create token

6a8902f5

Fix linters

72a88c99

Make token process local and thread safe

a46d6dc5

Skip test_zero1 to see if GPU are good

36361ed9

alanwaketan force pushed from 39c00923 to 36361ed9 2 years ago

JackCaoG commented on 2023-04-21

Address V3 and remove thread safe guards

ff7885ce

Fix linters

4122a231

JackCaoG commented on 2023-04-21

JackCaoG approved these changes on 2023-04-21

nit

216b3c35

alanwaketan merged 44c2fa04 into master 2 years ago

Reviewers

JackCaoG

Assignees

alanwaketan

Labels

None yet

Milestone

No milestone

xla [Distributed] Move the cached all reduce token to C++ #4912 Merged

[Distributed] Move the cached all reduce token to C++ #4912

xla
[Distributed] Move the cached all reduce token to C++
#4912

Merged