benchmark
14615447 - fix huggingface models input issue in torchbench (#126579)

Commit
2 years ago
fix huggingface models input issue in torchbench (#126579) Summary: Fixes https://github.com/pytorch/benchmark/issues/2263. According to https://github.com/pytorch/pytorch/blob/main/benchmarks/dynamo/common.py#L509, example_inputs are formatted as dictionaries for HuggingFace models. However, this forward_pass function passes all inputs to mod with *, which may only pass the input_ids key in HuggingFace model's example inputs. To reproduce, run the following command. ```bash python pytorch/benchmarks/dynamo/torchbench.py --performance --inference -dcuda --only=hf_Bert --output=torchbench_inference.csv ``` X-link: https://github.com/pytorch/pytorch/pull/126579 Approved by: https://github.com/xuzhao9 Reviewed By: DanilBaibak Differential Revision: D57619425 Pulled By: FindHao fbshipit-source-id: 9074e227bab949c83768092cf019dfd590fe947b
Author
Parents
Loading