Update DDP result parser for gathering partial results (#1251)
Summary:
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1251
Usage:
First, start a job with
```
python userbenchmark/ddp_experiments/__init__.py --job_dir /full/path/to/dir
```
Take note of the jobid that gets printed.
Then you can run the following to get the results in a more easily readable format:
```
python userbenchmark/ddp_experiments/parse_ddp.py --results_dir path/to/dir --job_id 12345
```
It will look up path/to/dir/12345_0_log.out and parse out results wrapped like `<RESULT>{RESULT_JSON}</RESULT>`
Parsing results that are dumped into the stdout logs means that we can view partial results before the job completes.
The `--csv_out` flag can be used to dump the results in csv format for use in google sheets, etc.
This PR relies on https://github.com/pytorch/benchmark/pull/1245.
Test Plan: Imported from OSS
Reviewed By: xuzhao9
Differential Revision: D40454556
Pulled By: davidberard98
fbshipit-source-id: c6ffbf0c1dfd3f3d3089c00f3ab68d0ddd39dd97