[pytorch][gh1] Fix failing test (#79632)
Summary: See tasks, these tests are broken in fbsource
Test Plan: `buck test fbcode//caffe2/.github/scripts:`
Differential Revision: D37182246
Pull Request resolved: https://github.com/pytorch/pytorch/pull/79632
Approved by: https://github.com/malfet, https://github.com/seemethere
