DeepSpeed
use all_gather_into_tensor instead of all_gather
#4705

Merged

use all_gather_into_tensor instead of all_gather #4705

tjruwase merged 1 commit into deepspeedai:master from myfeature3

taozhiwei requested a review from

jeffra 2 years ago

taozhiwei requested a review from

tjruwase 2 years ago

taozhiwei requested a review from

mrwyattii 2 years ago

taozhiwei requested a review from

RezaYazdaniAminabadi 2 years ago

taozhiwei requested a review from

awan-10 2 years ago

taozhiwei requested a review from

cmikeh2 2 years ago

taozhiwei requested a review from

arashb 2 years ago

GuanhuaWang commented on 2023-11-21

GuanhuaWang assigned

GuanhuaWang 2 years ago

use all_gather_into_tensor instead of all_gather

1bd9c84f

GuanhuaWang approved these changes on 2023-11-28

tjruwase merged fd0a52c1 into master 2 years ago

taozhiwei deleted the myfeature3 branch 1 year ago

Reviewers

GuanhuaWang

tjruwase

jeffra

mrwyattii

awan-10

cmikeh2

arashb

Assignees

GuanhuaWang

Labels

None yet

Milestone

No milestone