DeepSpeed
Fix for fragmented linear inputs in ZeRO 3 Linear layers where reshap…
#881
Merged
Overview
Commits
6
Changes
View On GitHub

Fix for fragmented linear inputs in ZeRO 3 Linear layers where reshap… #881

jeffra merged 6 commits into master from samyamr/fix-for-fragmented-linear-inputs
samyam
samyam Fix for fragmented linear inputs in ZeRO 3 Linear layers where reshap…
e193901a
samyam samyam requested a review from arashashari arashashari 4 years ago
samyam samyam requested a review from awan-10 awan-10 4 years ago
samyam samyam requested a review from cli99 cli99 4 years ago
samyam samyam requested a review from conglongli conglongli 4 years ago
samyam samyam requested a review from eltonzheng eltonzheng 4 years ago
samyam samyam requested a review from jeffra jeffra 4 years ago
samyam samyam requested a review from minjiaz minjiaz 4 years ago
samyam samyam requested a review from niumanar niumanar 4 years ago
samyam samyam requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
samyam samyam requested a review from ShadenSmith ShadenSmith 4 years ago
samyam samyam requested a review from tjruwase tjruwase 4 years ago
samyam Enable memory efficient linear when ZeRO 3 model is initialized in St…
79b81eda
stas00
tjruwase Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs
27bd006c
jeffra Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs
8ea1f5f1
jeffra Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs
54ccc041
jeffra Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs
0d9fc3ba
jeffra
jeffra approved these changes on 2021-04-07
jeffra jeffra merged b5f56b2c into master 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum