pytorch

2d75346c - [Gradient Compression] Add a minimum compression rate threshold for PowerSGD communication hook (#52541)

[Gradient Compression] Add a minimum compression rate threshold for PowerSGD communication hook (#52541) Summary: Fixes #{52034} - Add a minimum compression rate threshold to `PowerSGDState` - Use the threshold to determine whether to compress high-rank tensors or not Pull Request resolved: https://github.com/pytorch/pytorch/pull/52541 Test Plan: No performance regression using rank-8 compression: baseline: f253000411 updated one: f253010955 Reviewed By: rohan-varma Differential Revision: D26594862 Pulled By: SciPioneer fbshipit-source-id: 2859a91b4ca6bd1862bf6cd6441dc2a89badb2d5