DeepSpeed
offline full fp32 weights reconstruction for zero 2+3 checkpoints
#892

Merged

offline full fp32 weights reconstruction for zero 2+3 checkpoints #892

tjruwase merged 1 commit into deepspeedai:master from stas00:consolidate-fp32-weights

full fp32 weights reconstruction for zero 2+3

2c453d49

stas00 requested a review from

arashashari 4 years ago

stas00 requested a review from

awan-10 4 years ago

stas00 requested a review from

cli99 4 years ago

stas00 requested a review from

conglongli 4 years ago

stas00 requested a review from

eltonzheng 4 years ago

stas00 requested a review from

jeffra 4 years ago

stas00 requested a review from

minjiaz 4 years ago

stas00 requested a review from

niumanar 4 years ago

stas00 requested a review from

RezaYazdaniAminabadi 4 years ago

stas00 requested a review from

samyam 4 years ago

stas00 requested a review from

ShadenSmith 4 years ago

stas00 requested a review from

tjruwase 4 years ago

stas00 changed the title ~~full fp32 weights reconstruction for zero 2+3~~ offline full fp32 weights reconstruction for zero 2+3 checkpoints 4 years ago

tjruwase approved these changes on 2021-03-26

tjruwase merged 7531c6bf into master 4 years ago

stas00 deleted the consolidate-fp32-weights branch 4 years ago

Reviewers

tjruwase

arashashari

awan-10

cli99

conglongli

eltonzheng

jeffra

minjiaz

niumanar

RezaYazdaniAminabadi

samyam

ShadenSmith

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed offline full fp32 weights reconstruction for zero 2+3 checkpoints #892 Merged

offline full fp32 weights reconstruction for zero 2+3 checkpoints #892

DeepSpeed
offline full fp32 weights reconstruction for zero 2+3 checkpoints
#892

Merged