Run only a subset for optim benchmarks, attempt to fix (#2392)
Summary:
A first attempt to fix https://github.com/pytorch/benchmark/actions/workflows/userbenchmark-regression-detector.yml by only running a subset of models
Test run: https://github.com/pytorch/benchmark/actions/runs/10065401507
Pull Request resolved: https://github.com/pytorch/benchmark/pull/2392
Reviewed By: xuzhao9
Differential Revision: D60136675
Pulled By: janeyx99
fbshipit-source-id: 26ba71e35aa96ce3f4152d8d2fd30f06990ac988