Fix the TorchBench CI when running with a benchmark branch. (#69795)
Summary:
Fixes TorchBench CI when user is running with their own branch
Supersedes https://github.com/pytorch/pytorch/pull/69770
Pull Request resolved: https://github.com/pytorch/pytorch/pull/69795
Reviewed By: malfet
Differential Revision: D33032886
Pulled By: xuzhao9
fbshipit-source-id: 82baee94df6925bf91bb575143efa058ce98b914
