DeepSpeed
Make reduce scatter optional for ZeRO-1 as workaround
#971
Merged

Commits
  • Make reduce scatter optional for ZeRO-1 as workaround
    tjruwase committed 5 years ago
  • Make allreduce default for ZeRO 1
    tjruwase committed 5 years ago
  • Merge branch 'master' into olruwase/zero_optional_reduce_scatter
    tjruwase committed 5 years ago
  • Merge branch 'master' into olruwase/zero_optional_reduce_scatter
    jeffra committed 5 years ago
  • Merge branch 'master' into olruwase/zero_optional_reduce_scatter
    jeffra committed 5 years ago
Loading