DeepSpeed
do allgather only in shared optimizer states groups
#4167
Merged
Overview
Commits
4
Changes
View On GitHub

do allgather only in shared optimizer states groups #4167

loadams merged 4 commits into deepspeedai:master from inkcherry:allgather
inkcherry
inkcherry skip all-gather
cd7d6b21
inkcherry add notes
d2e07414
inkcherry inkcherry requested a review from jeffra jeffra 2 years ago
inkcherry inkcherry requested a review from tjruwase tjruwase 2 years ago
tjruwase
tjruwase
tjruwase approved these changes on 2023-08-17
loadams Merge branch 'master' into allgather
e8985b69
loadams loadams enabled auto-merge 2 years ago
tjruwase Merge branch 'master' into allgather
076a8161
loadams loadams merged 7f3e82fe into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum