DeepSpeed
Add flexibility of pipeline parallel module and engine
#1399

Merged

Add flexibility of pipeline parallel module and engine #1399

tjruwase merged 4 commits into deepspeedai:master from master

Add flexibility of pipeline module and engine

f16f718b

hyunwoongko requested a review from

awan-10 4 years ago

hyunwoongko requested a review from

cli99 4 years ago

hyunwoongko requested a review from

conglongli 4 years ago

hyunwoongko requested a review from

eltonzheng 4 years ago

hyunwoongko requested a review from

jeffra 4 years ago

hyunwoongko requested a review from

minjiaz 4 years ago

hyunwoongko requested a review from

niumanar 4 years ago

hyunwoongko requested a review from

RezaYazdaniAminabadi 4 years ago

hyunwoongko requested a review from

samyam 4 years ago

hyunwoongko requested a review from

ShadenSmith 4 years ago

hyunwoongko requested a review from

tjruwase 4 years ago

tjruwase commented on 2021-09-27

Separate PRs

75ba9741

hyunwoongko changed the title ~~Add flexibility of pipeline module and engine & fix contiguous checkpointing bugs~~ Add flexibility of pipeline module and engine 4 years ago

Separate PRs

2c86eaa1

hyunwoongko changed the title ~~Add flexibility of pipeline module and engine~~ Add flexibility of pipeline parallel module and engine 4 years ago

Merge branch 'master' into master

d0908d0d

tjruwase commented on 2021-10-01

tjruwase approved these changes on 2021-10-01

tjruwase merged 30965ea7 into master 4 years ago

Reviewers

tjruwase

awan-10

cli99

conglongli

eltonzheng

jeffra

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Add flexibility of pipeline parallel module and engine #1399 Merged

Add flexibility of pipeline parallel module and engine #1399

DeepSpeed
Add flexibility of pipeline parallel module and engine
#1399

Merged