DeepSpeed
12aedac6 - add available memory check to accelerators (#4508)

Comment changes are shownComment changes are hidden
Commit
1 year ago
add available memory check to accelerators (#4508) * add available memory check to accelerator * catch case where nvmlInit fails * add pynvml to reqs * fix for cpu systems * Update accelerator/cuda_accelerator.py Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com> * simplify --------- Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
Author
Parents
  • accelerator
    • File
      abstract_accelerator.py
    • File
      cpu_accelerator.py
    • File
      cuda_accelerator.py
    • File
      mps_accelerator.py
    • File
      npu_accelerator.py
  • requirements
    • File
      requirements.txt