Add more exceptions, improve -s and -m interaction (#1583)
Summary:
This PR is another step towards subprocessing the optim benchmarks.
1. Fixes more bugs introduced in latest nightlies (yolov3 expects a batchsize that is a multiple of # GPUs).
2. Change -s and -m interaction. When a subset of models is asked for, we will run the intersection of the models asked by the user (with -m) and the subset. Previously, we just ignored -m.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1583
Test Plan: Tested locally, and also https://github.com/pytorch/benchmark/actions/runs/4813239564/jobs/8569513495 which should ONLY run yolov3 and not fail at it.
Reviewed By: xuzhao9
Differential Revision: D45329753
Pulled By: janeyx99
fbshipit-source-id: 19c9fa6d65a02d085b494a73eab63c63538e76ff
