DeepSpeed
stage_1_and_2.py: no allreduce needed when mp size is 1
#2494

Merged

stage_1_and_2.py: no allreduce needed when mp size is 1 #2494

tjruwase merged 1 commit into deepspeedai:master from guoyejun:noallreduce

stage_1_and_2.py: no allreduce needed when mp size is 1

b1cd7560

guoyejun requested a review from

jeffra 3 years ago

guoyejun requested a review from

samyam 3 years ago

guoyejun requested a review from

tjruwase 3 years ago

guoyejun requested a review from

ShadenSmith 3 years ago

guoyejun requested a review from

conglongli 3 years ago

guoyejun requested a review from

awan-10 3 years ago

guoyejun requested a review from

cli99 3 years ago

guoyejun requested a review from

eltonzheng 3 years ago

guoyejun requested a review from

minjiaz 3 years ago

guoyejun requested a review from

RezaYazdaniAminabadi 3 years ago

guoyejun requested a review from

duli2012 3 years ago

guoyejun requested a review from

mrwyattii 3 years ago

guoyejun requested a review from

yaozhewei 3 years ago

guoyejun requested a review from

arashb 3 years ago

guoyejun requested a review from

xiaoxiawu-microsoft 3 years ago

guoyejun requested a review from

samadejacobs 3 years ago

guoyejun requested a review from

cmikeh2 3 years ago

guoyejun requested a review from

GuanhuaWang 3 years ago

tjruwase approved these changes on 2022-11-10

tjruwase merged 3ca9878d into master 3 years ago

Reviewers

tjruwase

jeffra

samyam

ShadenSmith

conglongli

awan-10

cli99

eltonzheng

minjiaz

RezaYazdaniAminabadi

duli2012

mrwyattii

yaozhewei

arashb

xiaoxiawu-microsoft

samadejacobs

cmikeh2

GuanhuaWang

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed stage_1_and_2.py: no allreduce needed when mp size is 1 #2494 Merged

stage_1_and_2.py: no allreduce needed when mp size is 1 #2494

DeepSpeed
stage_1_and_2.py: no allreduce needed when mp size is 1
#2494

Merged