DeepSpeed
Add more synchronizations and barriers for the multi-gpu inference case
#1309

Merged

Add more synchronizations and barriers for the multi-gpu inference case #1309

RezaYazdaniAminabadi merged 6 commits into master from reyazda/mp_inference

add more synchronizations and barriers for resolving gpu-halt issue

045d19d9

removing unuseful broadcasts

5038b077

RezaYazdaniAminabadi requested a review from

awan-10 4 years ago

RezaYazdaniAminabadi requested a review from

cli99 4 years ago

RezaYazdaniAminabadi requested a review from

conglongli 4 years ago

RezaYazdaniAminabadi requested a review from

eltonzheng 4 years ago

RezaYazdaniAminabadi requested a review from

jeffra 4 years ago

RezaYazdaniAminabadi requested a review from

minjiaz 4 years ago

RezaYazdaniAminabadi requested a review from

niumanar 4 years ago

RezaYazdaniAminabadi requested a review from

samyam 4 years ago

RezaYazdaniAminabadi requested a review from

ShadenSmith 4 years ago

RezaYazdaniAminabadi requested a review from

tjruwase 4 years ago

Merge branch 'master' into reyazda/mp_inference

77451e8e

hyunwoongko commented on 2021-08-21

Merge branch 'master' into reyazda/mp_inference

a116250f

Merge branch 'master' into reyazda/mp_inference

a9c76ba2

Merge branch 'master' into reyazda/mp_inference

7c629a40

jeffra approved these changes on 2021-08-27

RezaYazdaniAminabadi merged 0ec11daa into master 4 years ago

mrwyattii deleted the reyazda/mp_inference branch 2 years ago

Reviewers

jeffra

hyunwoongko

awan-10

cli99

conglongli

eltonzheng

minjiaz

niumanar

samyam

ShadenSmith

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Add more synchronizations and barriers for the multi-gpu inference case #1309 Merged

Add more synchronizations and barriers for the multi-gpu inference case #1309

DeepSpeed
Add more synchronizations and barriers for the multi-gpu inference case
#1309

Merged