Add initial fambench support to e2e_models (#821)
Summary:
Add FAMBench submodule and xlmr support.
The following command runs the fambench xlmr inference:
```
$ python run_e2e.py fambench_xlmr
{"device": "cuda", "device_num": 1, "test": "eval", "num_examples": 160, "batch_size": 16, "result": {"latency": 23.143840166999997, "qps": 6.913286595719689}}
```
Adding the FAMBench submodule also enables us to add those models to TorchBench.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/821
Reviewed By: erichan1
Differential Revision: D35147606
Pulled By: xuzhao9
fbshipit-source-id: 592cc60923cce2f19c9657218155430df57314eb