DeepSpeed
Wrong partition_id while copying fp32_params -> fp16 params in Z2 for MoE
#2058
Merged
Overview
Commits
1
Changes
View On GitHub

Wrong partition_id while copying fp32_params -> fp16 params in Z2 for MoE #2058

siddharth9820 merged 1 commit into master from siddharth/moe-z2-bug-fix
siddharth9820
siddharth9820 correct partition_id in fp32 param -> fp16 param for MoE+z2
43dac83e
siddharth9820 siddharth9820 requested a review from jeffra jeffra 3 years ago
siddharth9820 siddharth9820 requested a review from samyam samyam 3 years ago
siddharth9820 siddharth9820 requested a review from tjruwase tjruwase 3 years ago
siddharth9820 siddharth9820 requested a review from ShadenSmith ShadenSmith 3 years ago
siddharth9820 siddharth9820 requested a review from conglongli conglongli 3 years ago
siddharth9820 siddharth9820 requested a review from awan-10 awan-10 3 years ago
siddharth9820 siddharth9820 requested a review from cli99 cli99 3 years ago
siddharth9820 siddharth9820 requested a review from eltonzheng eltonzheng 3 years ago
siddharth9820 siddharth9820 requested a review from minjiaz minjiaz 3 years ago
siddharth9820 siddharth9820 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
siddharth9820 siddharth9820 requested a review from duli2012 duli2012 3 years ago
siddharth9820 siddharth9820 requested a review from mrwyattii mrwyattii 3 years ago
siddharth9820 siddharth9820 requested a review from yaozhewei yaozhewei 3 years ago
siddharth9820 siddharth9820 requested a review from arashb arashb 3 years ago
siddharth9820 siddharth9820 requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
siddharth9820 siddharth9820 changed the title Wrong partition_id in the fp32_param -> fp16 param copying in Z2 for MoE Wrong partition_id while copying fp32_params -> fp16 params in Z2 for MoE 3 years ago
siddharth9820
jeffra
jeffra approved these changes on 2022-06-27
siddharth9820 siddharth9820 merged 38a00bee into master 3 years ago
siddharth9820 siddharth9820 deleted the siddharth/moe-z2-bug-fix branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum