DeepSpeed
Samyamr/cpu memory bloat fix zero
#233
Merged

Commits
  • Fix for CPU memory Bloating Issue caused by pyorch backward graph creation in allgather. Fixed by calling detach on tensors before calling all_gather
    samyam committed 6 years ago
  • Fix for CPU memory Bloating Issue caused by pyorch backward graph creation in allgather. Fixed by calling detach on tensors before calling all_gather
    samyam committed 6 years ago
  • Fix for CPU memory Bloating Issue caused by pyorch backward graph creation in allgather. Fixed by calling detach on tensors before calling all_gather
    samyam committed 6 years ago
Loading