Disable more of quicklint test (#58257)
Summary:
Essentially a followup to https://github.com/pytorch/pytorch/issues/57968. For now, this test is just too flaky to run on every PR.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/58257
Test Plan: The repro steps in https://github.com/pytorch/pytorch/issues/58253.
Reviewed By: walterddr
Differential Revision: D28424862
Pulled By: samestep
fbshipit-source-id: 00aed872fe505db67e48414b1234505a71099262
