DeepSpeed
[zero_to_fp32] fix to handle world_size
#1422
Merged
Overview
Commits
5
Changes
View On GitHub

[zero_to_fp32] fix to handle world_size #1422

tjruwase merged 5 commits into deepspeedai:master from stas00:zero_to_fp32_z2_pad_fix_main
stas00
stas00 [zero_to_fp32] fix to handle world_size
59ba27fd
stas00 stas00 requested a review from awan-10 awan-10 4 years ago
stas00 stas00 requested a review from cli99 cli99 4 years ago
stas00 stas00 requested a review from conglongli conglongli 4 years ago
stas00 stas00 requested a review from eltonzheng eltonzheng 4 years ago
stas00 stas00 requested a review from jeffra jeffra 4 years ago
stas00 stas00 requested a review from minjiaz minjiaz 4 years ago
stas00 stas00 requested a review from niumanar niumanar 4 years ago
stas00 stas00 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
stas00 stas00 requested a review from samyam samyam 4 years ago
stas00 stas00 requested a review from ShadenSmith ShadenSmith 4 years ago
stas00 stas00 requested a review from tjruwase tjruwase 4 years ago
tjruwase Merge branch 'master' into zero_to_fp32_z2_pad_fix_main
cc323f28
tjruwase
tjruwase
tjruwase approved these changes on 2021-10-01
tjruwase Merge branch 'master' into zero_to_fp32_z2_pad_fix_main
1b944ab5
tjruwase Merge branch 'master' into zero_to_fp32_z2_pad_fix_main
a01721a9
stas00 stas00 changed the title [WIP] [zero_to_fp32] fix to handle world_size [zero_to_fp32] fix to handle world_size 4 years ago
tjruwase Merge branch 'master' into zero_to_fp32_z2_pad_fix_main
606dd638
tjruwase tjruwase merged dd6bf4d0 into master 4 years ago
stas00 stas00 deleted the zero_to_fp32_z2_pad_fix_main branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum