Fix fuser tests on sandcastle (#19684)
Summary:
suo
Pull Request resolved: https://github.com/pytorch/pytorch/pull/19684
Reviewed By: suo
Differential Revision: D15067942
Pulled By: jamesr66a
fbshipit-source-id: 697a836ea37dab78fffd092194cecd8294ca9907
