Improve the regression detector to generate bisection config (#1710)
Summary:
To support bisection in regression detection, we need to add the following fields to `TorchBenchABTestResult`:
- `control_only_metrics: Dict[str, float]`
- `treatment_only_metrics: Dict[str, float]`
- `bisection: str = "pytorch"`
- `bisection_mode: str = "bisect"`
- `bisection_config_file_path: Optional[str] = None`
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1710
Test Plan:
Test workflow: https://github.com/pytorch/benchmark/actions/runs/5149726362
Test regression file:
Test bisection workflow:
Reviewed By: FindHao
Differential Revision: D46375050
Pulled By: xuzhao9
fbshipit-source-id: 48e49288be72bcf9c736f361169f1cae95115793