benchmark

b26d77a6 - Skip most pt2 forloop impls, add option to ignore skips (#1594)

Skip most pt2 forloop impls, add option to ignore skips (#1594) Summary: 1. The working benchmarks are now taking very long to run. I've rootcaused it as the dynamo tracing part of for-loop optimizers, which are known to be slow (see the comment). Thus, we should not waste resources => let's skip most of them! Now, we will run pt2 on only our designated subset of models (defined by SUBSET_OF_MODELS) 2. Since we now have many exclusions and mlazos may want to start unskipping certain things, I've added an overall option to ignore all skips. This way, one does not have to parse the skips and remove the relevant exclusion to run a certain config. Lastly, reorder skips so that the most likely to be hit ones are first (though this probably is negligible for perf). Pull Request resolved: https://github.com/pytorch/benchmark/pull/1594 Reviewed By: albanD Differential Revision: D45371125 Pulled By: janeyx99 fbshipit-source-id: 292fd9a2958501150230242e2809d8fe74ec2c59