benchmark
e6d216b1 - Add TorchBench V2 score (#700)

Commit
4 years ago
Add TorchBench V2 score (#700) Summary: Add TorchBench score v2. It contains three parts: total score, delta score, and domain scores. An example output: ``` { "file": "20211225_134720_9.json", "pytorch_version": "1.11.0.dev20211222+cu113", "score": { "total": 1000.0, "delta": 0.0, "domain": { "cuda-train-overall": 1000.0, "cuda-train-nlp": 1000.0, "cuda-train-classification": 1000.0, "cuda-train-segmentation": 1000.0, "cuda-train-speech": 1000.0, "cuda-train-recommendation": 1000.0, "cuda-eval-overall": 1000.0, "cuda-eval-nlp": 1000.0, "cuda-eval-classification": 1000.0, "cuda-eval-segmentation": 1000.0, "cuda-eval-speech": 1000.0, "cuda-eval-recommendation": 1000.0, "cpu-train-overall": 1000.0, "cpu-train-nlp": 1000.0, "cpu-train-classification": 1000.0, "cpu-train-segmentation": 1000.0, "cpu-train-speech": 1000.0, "cpu-train-recommendation": 1000.0, "cpu-eval-overall": 1000.0, "cpu-eval-nlp": 1000.0, "cpu-eval-classification": 1000.0, "cpu-eval-segmentation": 1000.0, "cpu-eval-speech": 1000.0, "cpu-eval-recommendation": 1000.0 } } } ``` Pull Request resolved: https://github.com/pytorch/benchmark/pull/700 Reviewed By: erichan1 Differential Revision: D33665497 Pulled By: xuzhao9 fbshipit-source-id: 9b09c8237cc5a2fc0584e579af5d14ed0045e60f
Author
Parents
Loading