benchmark
5b046066 - Update DDP result parser for gathering partial results (#1251)

Commit
3 years ago
Update DDP result parser for gathering partial results (#1251) Summary: Pull Request resolved: https://github.com/pytorch/benchmark/pull/1251 Usage: First, start a job with ``` python userbenchmark/ddp_experiments/__init__.py --job_dir /full/path/to/dir ``` Take note of the jobid that gets printed. Then you can run the following to get the results in a more easily readable format: ``` python userbenchmark/ddp_experiments/parse_ddp.py --results_dir path/to/dir --job_id 12345 ``` It will look up path/to/dir/12345_0_log.out and parse out results wrapped like `<RESULT>{RESULT_JSON}</RESULT>` Parsing results that are dumped into the stdout logs means that we can view partial results before the job completes. The `--csv_out` flag can be used to dump the results in csv format for use in google sheets, etc. This PR relies on https://github.com/pytorch/benchmark/pull/1245. Test Plan: Imported from OSS Reviewed By: xuzhao9 Differential Revision: D40454556 Pulled By: davidberard98 fbshipit-source-id: c6ffbf0c1dfd3f3d3089c00f3ab68d0ddd39dd97
Author
Parents
Loading