Metrics wrapper part 2 (#1449)
* first pass at logic to retrieve old metrics and run regression checks
* clean up and document
* remove debug statement
* raise instead of sys.exit and print to stderr
* required args and different empty string check
* raise early if child process has non-0 exit code
