DeepSpeed
1c9e5ef2 - Check overflow on device without host synchronization for each tensor (#5115)

Comment changes are shownComment changes are hidden
Commit
1 year ago
Check overflow on device without host synchronization for each tensor (#5115) Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Author
Parents
  • deepspeed/runtime/zero
    • File
      stage_1_and_2.py