benchmark

e89c2b32 - Add T5 e2e_benchmark translation task with support for DDP (#1122)

Add T5 e2e_benchmark translation task with support for DDP (#1122) Summary: What this benchmark will have - Add T5 e2e benchmark - Allow DDP and Deepspeed to run on T5 - Have both train and eval only modes, and include eval as part of train - Add new wmt16 dataset for general translation tasks. Can be extended to other seq2seq models. To Do Later - Add FSDP Pull Request resolved: https://github.com/pytorch/benchmark/pull/1122 Reviewed By: xuzhao9 Differential Revision: D39072153 Pulled By: erichan1 fbshipit-source-id: 6cc77940049204ba28e7abf12529f1407be8fc74