Fix slow tests on CPU (#1003)
Summary:
Partly address https://github.com/pytorch/benchmark/issues/895. Fix the slow cpu models https://github.com/pytorch/torchdynamo/blob/main/benchmarks/torchbench.py#L110.
For some slow models, like fastNLP_Bert, we are already using batch size 1. In this case:
- if the input data is from real data set (e.g. fastNLP_Bert input is from CMRC2018, vision_maskrcnn is from COCO 2017), we do nothing
- if the input data is randomly generated, we reduce the size of inputs (e.g. hf_* models)
We will continue address this problem in a follow-up PR, where we will reduce CPU batch size to around 1/8 of GPU batch size.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1003
Reviewed By: jansel
Differential Revision: D37538860
Pulled By: xuzhao9
fbshipit-source-id: d1ac6dec702e0e813ac1da679226a6bf154d8f60
