pytorch

05d33290 - [LTC] Cherry-pick fe053a2 (#66022)

[LTC] Cherry-pick fe053a2 (#66022) Summary: Part of the CI change has been reverted during the most recent merge-master commit. Let's re-revert that. Test Plan: PyTorch CI *linux-xenial-cuda11.1*.