Fix bisection workflow. (#621)
Summary:
By default, `conda install -c pytorch-nightly pytorch` installs `cudatoolkit=11.1` this will conflict with our CI environment which uses CUDA 11.3.
This PR fixes the issue to avoid cudatoolkit conflict.
Pull Request resolved: https://github.com/pytorch/benchmark/pull/621
Reviewed By: erichan1
Differential Revision: D32959100
Pulled By: xuzhao9
fbshipit-source-id: a592d805476265b75677f819f714169573768c2a
