Adds remaining OpInfos and removes redundant test generators (#55558)
Summary:
Per title.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/55558
Reviewed By: ngimel
Differential Revision: D28922522
Pulled By: mruberry
fbshipit-source-id: 89cefd93788bc8aa0683f4583cf5caa81aa2dc93
