benchmark
1ea5f44c - Migrate instruction count benchmark to userbenchmark (#1195)

Commit
3 years ago
Migrate instruction count benchmark to userbenchmark (#1195) Summary: This PR moves the instruction count benchmark to userbenchmark. Pytorch PR: https://github.com/pytorch/pytorch/pull/85359 Example workflow: https://github.com/pytorch/benchmark/actions/runs/3199793441 Example output (sliced): ``` { "name": "instruction-count", "environ": { "pytorch_git_version": "a5ce01692cbe501b464394f88491b06d9d15cd4c" }, "metrics": { "{\"label\": [\"Empty\", \"no allocation\"], \"autolabels\": {\"runtime\": \"Eager\", \"autograd\": \"Forward\", \"language\": \"Python\"}, \"num_threads\": 1}": 1.6907570010516793e-06, "{\"label\": [\"Empty\", \"no allocation\"], \"autolabels\": {\"runtime\": \"Eager\", \"autograd\": \"Forward\", \"language\": \"C++\"}, \"num_threads\": 1}": 3.5390214000000005e-07, "{\"label\": [\"Empty\", \"with allocation\"], \"autolabels\": {\"runtime\": \"Eager\", \"autograd\": \"Forward\", \"language\": \"Python\"}, \"num_threads\": 1}": 1.8958537955768406e-06, "{\"label\": [\"Empty\", \"with allocation\"], \"autolabels\": {\"runtime\": \"Eager\", \"autograd\": \"Forward\", \"language\": \"C++\"}, \"num_threads\": 1}": 6.3738475e-07, "{\"label\": [\"Empty\", \"overloads\", \"TensorOptions overload\", \"Case: 0\"], \"autolabels\": {\"runtime\": \"Eager\", \"autograd\": \"Forward\", \"language\": \"C++\"}, \"num_threads\": 1}": 2.8198315e-07, "{\"label\": [\"Empty\", \"overloads\", \"TensorOptions overload\", \"Case: 1\"], \"autolabels\": {\"runtime\": \"Eager\", \"autograd\": \"Forward\", \"language\": \"C++\"}, \"num_threads\": 1}": 2.8993428500000004e-07, "{\"label\": [\"Empty\", \"overloads\", \"TensorOptions overload\", \"Case: 2\"], \"autolabels\": {\"runtime\": \"Eager\", \"autograd\": \"Forward\", \"language\": \"C++\"}, \"num_threads\": 1}": 2.8010801500000004e-07, } ``` Pull Request resolved: https://github.com/pytorch/benchmark/pull/1195 Reviewed By: erichan1 Differential Revision: D39667869 Pulled By: erichan1 fbshipit-source-id: 543dd08bae51c6ebf78c0bec419e9c907e66c136
Author
Parents
Loading