Add canary model support to test.py (#1938)
Summary:
Allow `test.py` to also collect `canary` models on top of the regular ones by setting the environment variable `USE_CANARY_MODELS`.
```
pytest test.py --collect-only -k "check_device_cpu"
94/376 tests collected (282 deselected) in 0.11s
export USE_CANARY_MODELS=1
pytest test.py --collect-only -k "check_device_cpu"
110/440 tests collected (330 deselected) in 0.13s
```
where:
```
tree torchbenchmark/models/ -L 1|tail -1
96 directories, 1 file
tree torchbenchmark/canary_models/ -L 1|tail -1
16 directories, 0 files
```
Make `--canary` consistent with the default behaviour when `install.py` is called with no models, and download all collected models. Now, if you run `python3 install.py --canary`, the script will install all the models inside `torchbenchmark/models` and `torchbenchmark/canary_models`.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1938
Reviewed By: aaronenyeshi
Differential Revision: D49871774
Pulled By: xuzhao9
fbshipit-source-id: 33073ff72b4d8f5a311d3dc09277d49899ca23d7
