Revert "Add comprehensive minifier tests (#88022)"
This reverts commit 5ff600aa6e40c6b4d426594bbb1f446f005b7fb3.
Reverted https://github.com/pytorch/pytorch/pull/88022 on behalf of https://github.com/wconstab due to Seems to be causing CI failures relating to minifier test and some /tmp/ path not existing
