DeepSpeed

d24629f4 - [ROCm] Enable TestCUDABackward::test_backward unit tests (#3849)

[ROCm] Enable TestCUDABackward::test_backward unit tests (#3849) * Workaround to pass unit/ops/accelerators/test_accelerator_backward.py unit tests on ROCm * Rearranged is_rocm_pytorch() * Introduced is_rocm_pytorch() for ROCm * Fixed formatting errors * Function call * formatting fix --------- Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com> Co-authored-by: Logan Adams <loadams@microsoft.com>