benchmark
969d3be4 - Add --compare-backed-unbacked flag for benchmarking dynamic shapes (#175946)

Commit
32 days ago
Add --compare-backed-unbacked flag for benchmarking dynamic shapes (#175946) Summary: [lsakka@devgpu009.cco5 ~/pytorch10/pytorch (13694ac6)]$ python benchmarks/dynamo/huggingface.py --backend inductor --performance --inference --compare-backed-unbacked ``` --- AlbertForMaskedLM --- backed... 1.349x unbacked... 1.345x => diff: -0.3% --- AllenaiLongformerBase --- backed... 1.226x unbacked... 1.146x => diff: -6.5% --- BartForCausalLM --- backed... 1.022x unbacked... 1.015x => diff: -0.7% --- BertForMaskedLM --- backed... 1.186x unbacked... 1.187x => diff: +0.1% --- BlenderbotForCausalLM --- backed... 1.058x unbacked... 1.061x => diff: +0.3% ... ``` X-link: https://github.com/pytorch/pytorch/pull/175946 Approved by: https://github.com/jansel Reviewed By: wdvr Differential Revision: D95429517 fbshipit-source-id: 73b36865b88feb3718ac3e41e6843a7b60ca7a85
Author
Committer
Parents
Loading