Prepare for Azure Pipeline for multi-gpu tests (#55600)
Summary:
Previous PR: https://github.com/pytorch/pytorch/issues/52490
Pull Request resolved: https://github.com/pytorch/pytorch/pull/55600
Reviewed By: albanD, seemethere
Differential Revision: D27667544
Pulled By: malfet
fbshipit-source-id: f5843379807d8c95f3791d19ac0ab2d1973fa087
