Revert "[dynamo 3.11] enable dynamo unittests in 3.11 (#98104)"
This reverts commit 0066f3405f290ab6ef379abea6945058f8eb7ce5.
Reverted https://github.com/pytorch/pytorch/pull/98104 on behalf of https://github.com/huydhn due to Sorry for reverting your PR, but it is failing on CPU 3.11 test in trunk https://hud.pytorch.org/pytorch/pytorch/commit/0066f3405f290ab6ef379abea6945058f8eb7ce5. This is probably a landrace
