DeepSpeed
do allgather only in shared optimizer states groups
#4167
Merged

Commits
  • skip all-gather
    inkcherry committed 2 years ago
  • add notes
    inkcherry committed 2 years ago
  • Merge branch 'master' into allgather
    loadams committed 2 years ago
  • Merge branch 'master' into allgather
    tjruwase committed 2 years ago
Loading