DeepSpeed
fix ZERO_OPTIMIZATION_REDUCE_SCATTER_DEFAULT default value
#1058
Merged
Overview
Commits
4
Changes
View On GitHub

fix ZERO_OPTIMIZATION_REDUCE_SCATTER_DEFAULT default value #1058

jeffra merged 4 commits into deepspeedai:master from mpjlu:fixReduceScatter
mpjlu
mpjlu fix Reduce Scatter default value
ad89cf7a
mpjlu mpjlu requested a review from arashashari arashashari 5 years ago
mpjlu mpjlu requested a review from awan-10 awan-10 5 years ago
mpjlu mpjlu requested a review from cli99 cli99 5 years ago
mpjlu mpjlu requested a review from conglongli conglongli 5 years ago
mpjlu mpjlu requested a review from eltonzheng eltonzheng 5 years ago
mpjlu mpjlu requested a review from jeffra jeffra 5 years ago
mpjlu mpjlu requested a review from minjiaz minjiaz 5 years ago
mpjlu mpjlu requested a review from niumanar niumanar 5 years ago
mpjlu mpjlu requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
mpjlu mpjlu requested a review from samyam samyam 5 years ago
mpjlu mpjlu requested a review from ShadenSmith ShadenSmith 5 years ago
mpjlu mpjlu requested a review from tjruwase tjruwase 5 years ago
mpjlu
e-sha
mpjlu
jeffra
mpjlu
jeffra
jeffra Merge branch 'master' into fixReduceScatter
02a63e43
mpjlu
mpjlu commented on 2021-05-20
mpjlu Update constants.py
5dbb6719
jeffra Merge branch 'master' into fixReduceScatter
3bc3a913
jeffra
jeffra approved these changes on 2021-05-21
jeffra jeffra merged 093e59ec into master 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum