DeepSpeed
Use mpu in zero.Init()
#1325
Merged

Use mpu in zero.Init() #1325

jeffra merged 10 commits into master from olruwase/deepspeed_config_mpu
tjruwase
tjruwase Use mpu in zero.Init()
3e00e389
tjruwase tjruwase requested a review from jeffra jeffra 4 years ago
tjruwase tjruwase requested a review from awan-10 awan-10 4 years ago
tjruwase tjruwase requested a review from cli99 cli99 4 years ago
tjruwase tjruwase requested a review from conglongli conglongli 4 years ago
tjruwase tjruwase requested a review from eltonzheng eltonzheng 4 years ago
tjruwase tjruwase requested a review from minjiaz minjiaz 4 years ago
tjruwase tjruwase requested a review from niumanar niumanar 4 years ago
tjruwase tjruwase requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
tjruwase tjruwase requested a review from samyam samyam 4 years ago
tjruwase tjruwase requested a review from ShadenSmith ShadenSmith 4 years ago
tjruwase tjruwase removed review request from ShadenSmith ShadenSmith 4 years ago
tjruwase tjruwase removed review request from samyam samyam 4 years ago
tjruwase tjruwase removed review request from conglongli conglongli 4 years ago
tjruwase tjruwase removed review request from awan-10 awan-10 4 years ago
tjruwase tjruwase removed review request from cli99 cli99 4 years ago
tjruwase tjruwase removed review request from eltonzheng eltonzheng 4 years ago
tjruwase tjruwase removed review request from minjiaz minjiaz 4 years ago
tjruwase tjruwase removed review request from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
tjruwase tjruwase removed review request from niumanar niumanar 4 years ago
tjruwase Merge branch 'master' into olruwase/deepspeed_config_mpu
fc1941a9
tjruwase Merge branch 'master' into olruwase/deepspeed_config_mpu
ce0dc821
tjruwase Merge branch 'master' into olruwase/deepspeed_config_mpu
db0ee8c5
tjruwase Merge branch 'master' into olruwase/deepspeed_config_mpu
24b9c510
tjruwase Merge branch 'master' into olruwase/deepspeed_config_mpu
1665f2e5
tjruwase Merge branch 'master' into olruwase/deepspeed_config_mpu
1066994b
tjruwase Merge branch 'master' into olruwase/deepspeed_config_mpu
1ca424fc
tjruwase Merge branch 'master' into olruwase/deepspeed_config_mpu
361ebba1
tjruwase Merge branch 'master' into olruwase/deepspeed_config_mpu
15ea4c55
jeffra
jeffra approved these changes on 2021-09-01
jeffra jeffra enabled auto-merge (squash) 4 years ago
jeffra jeffra merged e08c239c into master 4 years ago
mrwyattii mrwyattii deleted the olruwase/deepspeed_config_mpu branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone