pytorch

5654e633 - Use batched operations for PowerSGD

Use batched operations for PowerSGD This implements method proposed in #74907 Pull Request resolved: https://github.com/pytorch/pytorch/pull/75157 Approved by: https://github.com/wayi1, https://github.com/rohan-varma