DeepSpeed
[zero.Init] post_init partitining is to be run only by a child module
#1202
Merged

[zero.Init] post_init partitining is to be run only by a child module #1202

stas00
stas00 post_init to be run only by a child module
4004e149
stas00 stas00 requested a review from awan-10 awan-10 4 years ago
stas00 stas00 requested a review from cli99 cli99 4 years ago
stas00 stas00 requested a review from conglongli conglongli 4 years ago
stas00 stas00 requested a review from eltonzheng eltonzheng 4 years ago
stas00 stas00 requested a review from jeffra jeffra 4 years ago
stas00 stas00 requested a review from minjiaz minjiaz 4 years ago
stas00 stas00 requested a review from niumanar niumanar 4 years ago
stas00 stas00 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
stas00 stas00 requested a review from samyam samyam 4 years ago
stas00 stas00 requested a review from ShadenSmith ShadenSmith 4 years ago
stas00 stas00 requested a review from tjruwase tjruwase 4 years ago
stas00 stas00 changed the title [zero] post_init partitining is to be run only by a child module [zero.Init] post_init partitining is to be run only by a child module 4 years ago
stas00 better solution
d3818276
stas00 add test
d61e7ce8
stas00 safer attr name
33542d2f
stas00 wants half()
a1c4adfb
stas00 improve doc
4eaf5e2e
samyam
samyam approved these changes on 2021-07-09
tjruwase Merge branch 'master' into zero-init-child-only-post_init
9c7eae40
tjruwase Merge branch 'master' into zero-init-child-only-post_init
f7e7147c
tjruwase tjruwase merged 497b741f into master 4 years ago
stas00 stas00 deleted the zero-init-child-only-post_init branch 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone