Fix binary testing if torchtrition is mandatory (#90017)
Prep-change for a builder, where torchtrition is installed from custom nightly downloads repo
Pull Request resolved: https://github.com/pytorch/pytorch/pull/90017
Approved by: https://github.com/seemethere
