Revert D29147009: [pytorch][PR] refine disabled test
Test Plan: revert-hammer
Differential Revision:
D29147009 (https://github.com/pytorch/pytorch/commit/5fd6ead0970a539f0bd1b24efbe6fc73bd70603f)
Original commit changeset: 37e01ac6e8d6
fbshipit-source-id: e9cd819fd819e3d653deda3b7a981c39ec0452f4
