Add ModuleInfo-based CPU / GPU parity tests (#68097)
Summary:
Continuation of https://github.com/pytorch/pytorch/issues/64694; fixes issues with the diff there
Pull Request resolved: https://github.com/pytorch/pytorch/pull/68097
Reviewed By: mruberry
Differential Revision: D32300650
Pulled By: jbschlosser
fbshipit-source-id: f3a5e72b019d4eddd7202854999eab61fffc9006
