disable nadam on timm_vision_transformer, run pt2 on large (#1816)
Summary:
Fixes the errors logs in the latest nightlies. Fixes https://github.com/pytorch/benchmark/issues/1815, https://github.com/pytorch/benchmark/issues/1812, https://github.com/pytorch/benchmark/issues/1807, https://github.com/pytorch/benchmark/issues/1804, https://github.com/pytorch/benchmark/issues/1794.
Also adds timm_vision_transformer_large as a PT2 model to run as it is larger and thus more meaningful.
Test Plan:
https://github.com/pytorch/benchmark/actions/runs/5813640590
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1816Imported from GitHub, without a `Test Plan:` line.
Reviewed By: xuzhao9
Differential Revision: D48204243
Pulled By: janeyx99
fbshipit-source-id: 8ba7fe1315ae94cbd922ff57356050f041eb143c