Add FSDP to T5 (#1142)
Summary:
Enable FullyShardedDataParallel for T5 benchmark.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1142
Reviewed By: xuzhao9
Differential Revision: D39402262
Pulled By: erichan1
fbshipit-source-id: 7dbace517bc064df810c758cc0e69fc9a98447ef