Fix bisection failures (#1722)
Summary:
Failed bisection job example: https://github.com/pytorch/benchmark/issues/1706 (2023-05-31)
Test workflow:
- [ ] 2023-05-19: https://github.com/pytorch/benchmark/issues/1666, https://github.com/pytorch/benchmark/actions/runs/5212009491
- [x] 2023-05-26: https://github.com/pytorch/benchmark/actions/runs/5204716477
- [x] 2023-05-28: https://github.com/pytorch/benchmark/actions/runs/5205215214
- [x] 2023-05-31: https://github.com/pytorch/benchmark/issues/1706, https://github.com/pytorch/benchmark/actions/runs/5181836501/jobs/9337892610
- [x] 2023-05-31 (2nd try): https://github.com/pytorch/benchmark/actions/runs/5210977060
- [x] 2023-06-08: https://github.com/pytorch/benchmark/actions/runs/5215399217
Pull Request resolved: https://github.com/pytorch/benchmark/pull/1722
Reviewed By: janeyx99
Differential Revision: D46595260
Pulled By: xuzhao9
fbshipit-source-id: 655a989bb03e0563045add63121387a38b01aacd
