benchmarks: add script to aggregate results from result_analyzer (#5829)
* benchmarks: extract tiers into their own file
So that they can be reused in other files. The second user is coming
next.
* benchmarks: add aggregate.py
This script processes output CSV files from results_analyzer to
generate CSV/plots. Example:
$ for fmt in csv png; do \
for acc in v100 a6000; do \
for report in latest histogram speedup; do \
for test in training inference; do \
FILENAME=/tmp/png/$acc-$test-$report.$fmt; \
python3 aggregate.py \
--accelerator=$acc \
--test=$test \
-i /tmp/csv-depot \
--report=$report \
--title="All benchmarks" \
--format=$fmt > $FILENAME || break; \
chmod 644 $FILENAME; \
done; \
done; \
done; \
done
This generates plots and CSV files to summarize the latest
performance vs. Inductor, as well as a histogram and a geomean
speedup over time for all the input CSV data in /tmp/csv-depot.
Results are broken down per accelerator and either inference or
training.
To generate results per tier, we just have to pass --filter-by-tier
to the above and update the title to --title="Tier 1".