DeepSpeed
Wrong partition_id while copying fp32_params -> fp16 params in Z2 for MoE
#2058
Merged
Overview
Commits
1
Changes
View On GitHub

Wrong partition_id while copying fp32_params -> fp16 params in Z2 for MoE #2058

siddharth9820 merged 1 commit into master from siddharth/moe-z2-bug-fix
siddharth9820
siddharth9820 correct partition_id in fp32 param -> fp16 param for MoE+z2
43dac83e
siddharth9820 siddharth9820 requested a review from jeffra jeffra 4 years ago
siddharth9820 siddharth9820 requested a review from samyam samyam 4 years ago
siddharth9820 siddharth9820 requested a review from tjruwase tjruwase 4 years ago
siddharth9820 siddharth9820 requested a review from ShadenSmith ShadenSmith 4 years ago
siddharth9820 siddharth9820 requested a review from conglongli conglongli 4 years ago
siddharth9820 siddharth9820 requested a review from awan-10 awan-10 4 years ago
siddharth9820 siddharth9820 requested a review from cli99 cli99 4 years ago
siddharth9820 siddharth9820 requested a review from eltonzheng eltonzheng 4 years ago
siddharth9820 siddharth9820 requested a review from minjiaz minjiaz 4 years ago
siddharth9820 siddharth9820 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
siddharth9820 siddharth9820 requested a review from duli2012 duli2012 4 years ago
siddharth9820 siddharth9820 requested a review from mrwyattii mrwyattii 4 years ago
siddharth9820 siddharth9820 requested a review from yaozhewei yaozhewei 4 years ago
siddharth9820 siddharth9820 requested a review from arashb arashb 4 years ago
siddharth9820 siddharth9820 requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 4 years ago
siddharth9820 siddharth9820 changed the title Wrong partition_id in the fp32_param -> fp16 param copying in Z2 for MoE Wrong partition_id while copying fp32_params -> fp16 params in Z2 for MoE 4 years ago
siddharth9820
jeffra
jeffra approved these changes on 2022-06-27
siddharth9820 siddharth9820 merged 38a00bee into master 4 years ago
siddharth9820 siddharth9820 deleted the siddharth/moe-z2-bug-fix branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum