Increase delta, exclude CPU reporting (#1641)
Summary:
Increases the delta to 10%, as optimizer step is a small step so noise is not unexpected.
Also removes reporting for CPU, though we still run the CPU benchmarks + record stats so that we leave a trace of numbers + ascertain functionality.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1641
Reviewed By: xuzhao9
Differential Revision: D45797565
Pulled By: janeyx99
fbshipit-source-id: 24117a5fcd11963b40ea7da076eec66217ea4593