[TestZeroRedundancyOptimizer] Add multi gpu checker (#53564)
Summary:
The test test_collect_shards fails on single GPU setup.
Enabling the multi gpu checker.
Signed-off-by: Jagadish Krishnamoorthy <jagdish.krishna@gmail.com>
Pull Request resolved: https://github.com/pytorch/pytorch/pull/53564
Reviewed By: H-Huang
Differential Revision: D26952325
Pulled By: rohan-varma
fbshipit-source-id: e8956f9277c7320024bece129767e83fbdf02b2c
