DeepSpeed
DS init should not broadcast or move zero.Init models
#3611
Merged

DS init should not broadcast or move zero.Init models #3611

jeffra merged 2 commits into master from olruwase/ds_3168
tjruwase
tjruwase DS init should not broadcast or move zero.Init models
b97179c3
tjruwase tjruwase requested a review from jeffra jeffra 2 years ago
tjruwase tjruwase requested a review from jomayeri jomayeri 2 years ago
tjruwase Merge branch 'master' into olruwase/ds_3168
f6faf146
jeffra
jeffra approved these changes on 2023-05-25
jomayeri
jomayeri approved these changes on 2023-05-25
jeffra jeffra merged d39c311f into master 2 years ago
jeffra jeffra deleted the olruwase/ds_3168 branch 2 years ago
stas00

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone