benchmark
d74740f1 - Add option to run AOT Precompile in benchmark (#164906)

Commit
1 year ago
Add option to run AOT Precompile in benchmark (#164906) Summary: Use the existing benchmark infra to get some signals for AOT precompile pass rate on OSS models. Here we also measure and log the loading time. ``` python ./benchmarks/dynamo/huggingface.py --accuracy --inference --aot-precompile python ./benchmarks/dynamo/timm_models.py --accuracy --inference --aot-precompile python ./benchmarks/dynamo/torchbench.py --accuracy --inference --aot-precompile ``` X-link: https://github.com/pytorch/pytorch/pull/164906 Approved by: https://github.com/zhxchen17 Reviewed By: seemethere Differential Revision: D84663648 fbshipit-source-id: be55867128d678bcff44d9ed7be3c90abffe066d
Author
Committer
Parents
Loading