Set cudnn.benchmark in timm and vision models to True by default (#1343)
Summary:
The upstream of [timm framework](https://github.com/rwightman/pytorch-image-models/blob/e7da205345dcf770ee4bedd62d06fad7a1458904/train.py#L372) has set `torch.backends.cudnn.benchmark` to True by default. It's better to keep it the same as the upstream.
The vision framework doesn't have an upstream repo, and it is supposed to use fixed input sizes each time in TorchBench. So it's better to enable cudnn.benchmark too.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1343
Reviewed By: davidberard98
Differential Revision: D42037886
Pulled By: xuzhao9
fbshipit-source-id: b5a3c513319d4e26f143f769412c552e37ac243a