DeepSpeed
Multi-node save pid support + allow sparse-attn extra
#1728

Merged

Multi-node save pid support + allow sparse-attn extra #1728

jeffra merged 2 commits into master from jeffra/savepid2

refactor save-pid to support multi-node

47a65279

add sparse attn as extra

3fde4248

jeffra requested a review from

awan-10 4 years ago

jeffra requested a review from

cli99 4 years ago

jeffra requested a review from

conglongli 4 years ago

jeffra requested a review from

eltonzheng 4 years ago

jeffra requested a review from

minjiaz 4 years ago

jeffra requested a review from

RezaYazdaniAminabadi 4 years ago

jeffra requested a review from

samyam 4 years ago

jeffra requested a review from

ShadenSmith 4 years ago

jeffra requested a review from

tjruwase 4 years ago

jeffra enabled auto-merge (squash) 4 years ago

tjruwase approved these changes on 2022-01-27

jeffra merged 9351266f into master 4 years ago

Reviewers

tjruwase

awan-10

cli99

conglongli

eltonzheng

minjiaz

samyam

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone