DeepSpeed
Fix all Pipeline Module Parameters being sent to cuda:0
#687

Merged

Fix all Pipeline Module Parameters being sent to cuda:0 #687

ShadenSmith merged 2 commits into deepspeedai:master from patch-1

Fix all Pipeline Module Parameters being sent to cuda:0

b95891be

sdtblck requested a review from

arashashari 5 years ago

sdtblck requested a review from

awan-10 5 years ago

sdtblck requested a review from

cli99 5 years ago

sdtblck requested a review from

conglongli 5 years ago

sdtblck requested a review from

eltonzheng 5 years ago

sdtblck requested a review from

jeffra 5 years ago

sdtblck requested a review from

minjiaz 5 years ago

sdtblck requested a review from

niumanar 5 years ago

sdtblck requested a review from

RezaYazdaniAminabadi 5 years ago

sdtblck requested a review from

samyam 5 years ago

sdtblck requested a review from

ShadenSmith 5 years ago

sdtblck requested a review from

tjruwase 5 years ago

change global_rank to local_rank

b9c6f70c

ShadenSmith approved these changes on 2021-04-21

ShadenSmith merged 669028f0 into master 4 years ago

Reviewers

ShadenSmith

arashashari

awan-10

cli99

conglongli

eltonzheng

jeffra

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Fix all Pipeline Module Parameters being sent to cuda:0 #687 Merged

Fix all Pipeline Module Parameters being sent to cuda:0 #687

DeepSpeed
Fix all Pipeline Module Parameters being sent to cuda:0
#687

Merged