DeepSpeed
stage_1_and_2.py: no allreduce needed when mp size is 1
#2494

Merged

stage_1_and_2.py: no allreduce needed when mp size is 1 #2494

tjruwase merged 1 commit into deepspeedai:master from guoyejun:noallreduce

stage_1_and_2.py: no allreduce needed when mp size is 1

b1cd7560

guoyejun requested a review from

jeffra 4 years ago

guoyejun requested a review from

samyam 4 years ago

guoyejun requested a review from

tjruwase 4 years ago

guoyejun requested a review from

ShadenSmith 4 years ago

guoyejun requested a review from

conglongli 4 years ago

guoyejun requested a review from

awan-10 4 years ago

guoyejun requested a review from

cli99 4 years ago

guoyejun requested a review from

eltonzheng 4 years ago

guoyejun requested a review from

minjiaz 4 years ago

guoyejun requested a review from

RezaYazdaniAminabadi 4 years ago

guoyejun requested a review from

duli2012 4 years ago

guoyejun requested a review from

mrwyattii 4 years ago

guoyejun requested a review from

yaozhewei 4 years ago

guoyejun requested a review from

arashb 4 years ago

guoyejun requested a review from

xiaoxiawu-microsoft 4 years ago

guoyejun requested a review from

samadejacobs 4 years ago

guoyejun requested a review from

cmikeh2 4 years ago

guoyejun requested a review from

GuanhuaWang 4 years ago

tjruwase approved these changes on 2022-11-10

tjruwase merged 3ca9878d into master 4 years ago

Reviewers

tjruwase

jeffra

samyam

ShadenSmith

conglongli

awan-10

cli99

eltonzheng

minjiaz

RezaYazdaniAminabadi

duli2012

mrwyattii

yaozhewei

arashb

xiaoxiawu-microsoft

samadejacobs

cmikeh2

GuanhuaWang

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed stage_1_and_2.py: no allreduce needed when mp size is 1 #2494 Merged

stage_1_and_2.py: no allreduce needed when mp size is 1 #2494

DeepSpeed
stage_1_and_2.py: no allreduce needed when mp size is 1
#2494

Merged