Revert "Backport currently dont work with some models if: (#86510)"
This reverts commit 4bfb7341819b3bfcaf65ddc136f25d23983740a7.
Reverted https://github.com/pytorch/pytorch/pull/86510 on behalf of https://github.com/facebook-github-bot due to Diff reverted internally
