PR #1548 Use cuda tensors for allgather

Use cuda tensors for allgather #1548

tjruwase merged 2 commits into master from olruwase/z3_allgather_base

Use cuda tensors for allgather

1a2b92bb

tjruwase requested a review from

jeffra 4 years ago

tjruwase requested a review from

awan-10 4 years ago

tjruwase requested a review from

cli99 4 years ago

tjruwase requested a review from

conglongli 4 years ago

tjruwase requested a review from

eltonzheng 4 years ago

tjruwase requested a review from

minjiaz 4 years ago

tjruwase requested a review from

niumanar 4 years ago

tjruwase requested a review from

RezaYazdaniAminabadi 4 years ago

tjruwase requested a review from

samyam 4 years ago

tjruwase requested a review from

ShadenSmith 4 years ago

Merge branch 'master' into olruwase/z3_allgather_base

12944fc4

jeffra approved these changes on 2021-11-11

tjruwase merged bd3ebddf into master 4 years ago

mrwyattii deleted the olruwase/z3_allgather_base branch 2 years ago

Reviewers

jeffra

awan-10

cli99

conglongli

eltonzheng

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Use cuda tensors for allgather #1548 Merged

Use cuda tensors for allgather #1548

DeepSpeed
Use cuda tensors for allgather
#1548

Merged