Clean up some tests to use common_utils.parametrize (#73853)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/73853
Test Plan: Imported from OSS
Reviewed By: albanD
Differential Revision: D34703585
Pulled By: soulitzer
fbshipit-source-id: 20a1ba5df7448c78dce866bbebfeabf3cdc960e0
(cherry picked from commit dd0e2af93d1db89c587ee513c8fb3e25aca7c566)