Revert D32175957: Adding custom testing based on opinfos input for ops with custom rules.
Test Plan: revert-hammer
Differential Revision:
D32175957 (https://github.com/pytorch/pytorch/commit/b8e165e8417892a3cc1cd439603c3854ef2ee2de)
Original commit changeset: 1cb51a7b6cbb
fbshipit-source-id: 29fd0750d9981758436c55eea2de40cdaddfb9be
