Improves the model quality of huggingface T5 (#644)
Summary:
This PR makes the following changes:
- Disable train because it doesn't fit on T4 (default bs=8)
- Use the largest eval bs=1 which fits on T4
Profiling of eval when bs=1:
Pull Request resolved: https://github.com/pytorch/benchmark/pull/644
Reviewed By: aaronenyeshi
Differential Revision: D33178373
Pulled By: xuzhao9
fbshipit-source-id: b91d4f8c7080156a308b784d3bfc4cd66ff18b09
