DeepSpeed
Fix partition id in the fp32->fp16 param copying step for z2+cpu-offload
#2059
Merged
Overview
Commits
7
Changes
View On GitHub

Fix partition id in the fp32->fp16 param copying step for z2+cpu-offload #2059

jeffra merged 7 commits into master from siddharth/moe-z2+offload-bug-fix
siddharth9820
siddharth9820 fix partition id for cpu offload
c101885e
siddharth9820 siddharth9820 requested a review from jeffra jeffra 3 years ago
siddharth9820 siddharth9820 requested a review from samyam samyam 3 years ago
siddharth9820 siddharth9820 requested a review from tjruwase tjruwase 3 years ago
siddharth9820 siddharth9820 requested a review from ShadenSmith ShadenSmith 3 years ago
siddharth9820 siddharth9820 requested a review from conglongli conglongli 3 years ago
siddharth9820 siddharth9820 requested a review from awan-10 awan-10 3 years ago
siddharth9820 siddharth9820 requested a review from cli99 cli99 3 years ago
siddharth9820 siddharth9820 requested a review from eltonzheng eltonzheng 3 years ago
siddharth9820 siddharth9820 requested a review from minjiaz minjiaz 3 years ago
siddharth9820 siddharth9820 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
siddharth9820 siddharth9820 requested a review from duli2012 duli2012 3 years ago
siddharth9820 siddharth9820 requested a review from mrwyattii mrwyattii 3 years ago
siddharth9820 siddharth9820 requested a review from yaozhewei yaozhewei 3 years ago
siddharth9820 siddharth9820 requested a review from arashb arashb 3 years ago
siddharth9820 siddharth9820 requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
siddharth9820 formatting changes
feb7270c
tjruwase Merge branch 'master' into siddharth/moe-z2+offload-bug-fix
dec43867
tjruwase
tjruwase commented on 2022-07-05
siddharth9820 corrected bug in torch cpu adam code path
a037f100
siddharth9820 Merge branch 'siddharth/moe-z2+offload-bug-fix' of github.com:microso…
6dfbe1ba
siddharth9820 Merge branch 'master' into siddharth/moe-z2+offload-bug-fix
78eef29c
siddharth9820 Merge branch 'master' into siddharth/moe-z2+offload-bug-fix
945f0aab
jeffra
jeffra approved these changes on 2022-07-07
jeffra jeffra merged b3388e14 into master 3 years ago
jeffra jeffra deleted the siddharth/moe-z2+offload-bug-fix branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum