DeepSpeed
Multi-node save pid support + allow sparse-attn extra
#1728

Merged

Multi-node save pid support + allow sparse-attn extra #1728

jeffra merged 2 commits into master from jeffra/savepid2

refactor save-pid to support multi-node

47a65279

add sparse attn as extra

3fde4248

jeffra requested a review from

awan-10 3 years ago

jeffra requested a review from

cli99 3 years ago

jeffra requested a review from

conglongli 3 years ago

jeffra requested a review from

eltonzheng 3 years ago

jeffra requested a review from

minjiaz 3 years ago

jeffra requested a review from

RezaYazdaniAminabadi 3 years ago

jeffra requested a review from

samyam 3 years ago

jeffra requested a review from

ShadenSmith 3 years ago

jeffra requested a review from

tjruwase 3 years ago

jeffra enabled auto-merge (squash) 3 years ago

tjruwase approved these changes on 2022-01-27

jeffra merged 9351266f into master 3 years ago

Reviewers

tjruwase

awan-10

cli99

conglongli

eltonzheng

minjiaz

samyam

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone