Revert "Quick fix for keep-going + reruns (#102569)"
This reverts commit 7f6edcf422d133b6fd747ec0775d1c840a91ee46.
Reverted https://github.com/pytorch/pytorch/pull/102569 on behalf of https://github.com/clee2000 due to broke a ton of stuff ([comment](https://github.com/pytorch/pytorch/pull/102569#issuecomment-1569167673))
