Revert "Add more functorch shards to PR CI (#81919)"
This reverts commit 68d18f217f93b1e952292c4bd5d6c9a65aa81dcd.
Reverted https://github.com/pytorch/pytorch/pull/81919 on behalf of https://github.com/janeyx99 due to Reverting in the meantime as the test skips are not working
