DeepSpeed
do allgather only in shared optimizer states groups
#4167

Merged

Commits

skip all-gather

inkcherry committed 2 years ago
add notes

inkcherry committed 2 years ago
Merge branch 'master' into allgather

loadams committed 2 years ago
Merge branch 'master' into allgather

tjruwase committed 2 years ago

Loading