pytorch

7c8c8cc2 - Use batched operations for PowerSGD

Use batched operations for PowerSGD This PR is a rebased version of #75157 which fixes CI issues Pull Request resolved: https://github.com/pytorch/pytorch/pull/76041 Approved by: https://github.com/albanD, https://github.com/rohan-varma