benchmark
7fcc8bc5 - Upload MPS benchmark results (#141087)

Commit
1 year ago
Upload MPS benchmark results (#141087) Summary: This uploads the MPS benchmark results to benchmark database. The data can then be queried, for example: ``` select benchmark, model, metric from oss_ci_benchmark_v3 where head_sha = '99a133116fee15aa1467165f2b209b37da53f189' and metric.name in ['eager_peak_mem', 'dynamo_peak_mem', 'speedup'] and model.name = 'BERT_pytorch' ``` I'm documenting the JSON format at https://github.com/pytorch/pytorch/wiki/How-to-integrate-with-PyTorch-OSS-benchmark-database ### Testing Locally, ``` PYTHONPATH=/Users/huydo/Storage/mine/benchmark python benchmarks/dynamo/torchbench.py --performance --only resnet152 --backend eager --training --devices mps --output test/test-reports/torchbench_training.csv ``` Workflow dispatch https://github.com/pytorch/pytorch/actions/runs/11927990520 X-link: https://github.com/pytorch/pytorch/pull/141087 Approved by: https://github.com/malfet Reviewed By: izaitsevfb Differential Revision: D66262910 Pulled By: huydhn fbshipit-source-id: 318fbb0ded0e85742aa441e023f5abf906398997
Author
Parents
Loading