DeepSpeed
Bug fix for norm calculation in absence of model parallel group
#551
Merged
Overview
Commits
1
Changes
View On GitHub

Bug fix for norm calculation in absence of model parallel group #551

samyam merged 1 commit into master from samyamr/model-parallel-allreduce-fix
samyam
samyam Bug fix for norm calculation in absence of model parallel group
24257439
samyam samyam requested a review from arashashari arashashari 5 years ago
samyam samyam requested a review from awan-10 awan-10 5 years ago
samyam samyam requested a review from cli99 cli99 5 years ago
samyam samyam requested a review from conglongli conglongli 5 years ago
samyam samyam requested a review from eltonzheng eltonzheng 5 years ago
samyam samyam requested a review from jeffra jeffra 5 years ago
samyam samyam requested a review from minjiaz minjiaz 5 years ago
samyam samyam requested a review from niumanar niumanar 5 years ago
samyam samyam requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
samyam samyam requested a review from ShadenSmith ShadenSmith 5 years ago
samyam samyam requested a review from tjruwase tjruwase 5 years ago
jeffra
jeffra approved these changes on 2020-11-23
samyam samyam merged 00c3a254 into master 5 years ago
mrwyattii mrwyattii deleted the samyamr/model-parallel-allreduce-fix branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum