PR #6059 Add out-of-place all-gather coalesced

Add out-of-place all-gather coalesced #6059

JackCaoG merged 3 commits into master from jeffhataws_allgather_out

jeffhataws requested a review from

alanwaketan 1 year ago

jeffhataws requested a review from

JackCaoG 1 year ago

jeffhataws added backport_2.2

jeffhataws force pushed from a860776c to 4058ee9d 1 year ago

jeffhataws force pushed from 3587ae2c to 2df3c56d 1 year ago

Add out-of-place all-gather coalesced

d8947026

Add all-gather coalesce tests; fix all-gather coalesce bug "len(input)"

0d6125cf

jeffhataws force pushed from 2df3c56d to 0d6125cf 1 year ago

JackCaoG commented on 2023-12-11

Reuse ordinal_tensors; _all_gather_using_all_reduce can't accept list…

55428064

JackCaoG approved these changes on 2023-12-11

JackCaoG merged e3012bf9 into master 1 year ago

Reviewers

JackCaoG

alanwaketan

Assignees

No one assigned

Labels

backport_2.2

Milestone

No milestone