Revert "Remove fixed skips (#108674)"
This reverts commit 518cfda2dd0e940603c74717b4cb33493a9ec908.
Reverted https://github.com/pytorch/pytorch/pull/108674 on behalf of https://github.com/huydhn due to Sorry for reverting this, but one test is failing on inductor https://hud.pytorch.org/pytorch/pytorch/commit/518cfda2dd0e940603c74717b4cb33493a9ec908, and it seems easier to revert this than disabling the test ([comment](https://github.com/pytorch/pytorch/pull/108674#issuecomment-1709310192))
