DeepSpeed
Generalize detection of ZeRO supported optimizers
#349
Merged

Commits
  • Improve test for ZeRO supported optimizers
    tjruwase committed 5 years ago
  • Rename test function
    tjruwase committed 5 years ago
  • Format fixes
    tjruwase committed 5 years ago
  • Add model tests that wraps client FusedAdam with fused fp16 optimizer
    tjruwase committed 5 years ago
  • Merge branch 'staging-zero-dual-v2' of github.com:microsoft/DeepSpeed into olruwase/zero-offload-valid-optimizers
    tjruwase committed 5 years ago
  • Merge branch 'staging-zero-dual-v2' of github.com:microsoft/DeepSpeed into olruwase/zero-offload-valid-optimizers
    tjruwase committed 5 years ago
  • Format fixes
    tjruwase committed 5 years ago
  • Merge branch 'staging-zero-dual-v2' of github.com:microsoft/DeepSpeed into olruwase/zero-offload-valid-optimizers
    tjruwase committed 5 years ago
Loading