Enable fx2trt and torch_tensorrt support across all TB models (#743)
Summary:
Still, fp16 is not supported. I will try to address the fp16 issue in a follow-up PR.
Sweep all models with command:
`python run_sweep.py -d cuda -t eval --fx2trt`
Result:
```
Running model BERT_pytorch ... [ TypeError ]
Running model Background_Matting ... [ NotImplemented ]
Running model LearningToPaint ... [ TypeError ]
Running model Super_SloMo ... [ NameError ]
Running model alexnet ... [ OK ]
Running model attention_is_all_you_need_pytorch ... [ TypeError ]
Running model dcgan ... [ OK ]
Running model demucs ... [ NameError ]
Running model densenet121 ... [ NotImplemented ]
Running model detectron2_maskrcnn ... [ UnserializableException ]
Running model dlrm ... [ RuntimeError ]
Running model drq ... [ UnserializableException ]
Running model fastNLP_Bert ... [ UnserializableException ]
Running model hf_Albert ... [ ValueError ]
Running model hf_Bart ... [ TypeError ]
Running model hf_Bert ... [ ValueError ]
Running model hf_BigBird ... [ ValueError ]
Running model hf_DistilBert ... [ ValueError ]
Running model hf_GPT2 ... [ ValueError ]
Running model hf_Longformer ... [ ValueError ]
Running model hf_Reformer ... [ ValueError ]
Running model hf_T5 ... [ TypeError ]
Running model mnasnet1_0 ... [ OK ]
Running model mobilenet_v2 ... [ OK ]
Running model mobilenet_v2_quantized_qat ... [ RuntimeError ]
Running model mobilenet_v3_large ... [ OK ]
Running model moco ... [ UnserializableException ]
Running model nvidia_deeprecommender ... [ OK ]
Running model opacus_cifar10 ... [ UnserializableException ]
Running model pyhpc_equation_of_state ... [ TypeError ]
Running model pyhpc_isoneutral_mixing ... [ TypeError ]
Running model pyhpc_turbulent_kinetic_energy ... [ TypeError ]
Running model pytorch_CycleGAN_and_pix2pix ... [ NotImplemented ]
Running model pytorch_stargan ... [ UnserializableException ]
Running model pytorch_struct ... [ NotImplemented ]
Running model pytorch_unet ... [ AttributeError ]
Running model resnet18 ... [ OK ]
Running model resnet50 ... [ OK ]
Running model resnet50_quantized_qat ... [ RuntimeError ]
Running model resnext50_32x4d ... [ OK ]
Running model shufflenet_v2_x1_0 ... [ OK ]
Running model soft_actor_critic ... [ UnserializableException ]
Running model speech_transformer ... [ TypeError ]
Running model squeezenet1_1 ... [ OK ]
Running model tacotron2 ... [ NotImplemented ]
Running model timm_efficientnet ... [ OK ]
Running model timm_nfnet ... [ UnserializableException ]
Running model timm_regnet ... [ UnserializableException ]
Running model timm_resnest ... [ OK ]
Running model timm_vision_transformer ... [ UnserializableException ]
Running model timm_vovnet ... [ UnserializableException ]
Running model tts_angular ... [ UnserializableException ]
Running model vgg16 ... [ OK ]
Running model vision_maskrcnn ... [ UnserializableException ]
Running model yolov3 ... [ UnserializableException ]
```
Pull Request resolved: https://github.com/pytorch/benchmark/pull/743
Reviewed By: yinghai
Differential Revision: D34151603
Pulled By: xuzhao9
fbshipit-source-id: 049d090584b2fc85499a214d96ae34c41d0a1c8e
benchmark
e0deda39 - Enable fx2trt and torch_tensorrt support across all TB models (#743)
