DeepSpeed
[MiCS] [Fix] saving and loading model checkpoint logic for MiCS sharding
#3440
Merged

Commits
  • fix mics save checkpoint hanging
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    Zhen Zhang committed 3 years ago
  • Merge branch 'master' of https://github.com/dmlc/DeepSpeed into mics-fix-ckpt
    Zhen Zhang committed 3 years ago
  • MiCS load_checkpoint
    Zhen Zhang committed 3 years ago
  • copyright
    Zhen Zhang committed 3 years ago
  • fix for torch-1.9.0
    Zhen Zhang committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Naming alignment
    Zhen Zhang committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • adding more test conditions for mics shard size
    Zhen Zhang committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • test with different shard sizes
    Zhen Zhang committed 3 years ago
  • Merge branch 'mics-fix-ckpt' of https://github.com/dmlc/DeepSpeed into mics-fix-ckpt
    Zhen Zhang committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • adding assertion for better error msg
    Zhen Zhang committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
  • Merge branch 'master' into mics-fix-ckpt
    zarzen committed 3 years ago
Loading