Fixes to prep for weights_only default flip (#2514)
Summary:
Some fixes for https://github.com/pytorch/pytorch/pull/137602
Pull Request resolved: https://github.com/pytorch/benchmark/pull/2514
Reviewed By: xuzhao9
Differential Revision: D64628614
Pulled By: mikaylagawarecki
fbshipit-source-id: edebf25cc6648919d5673a3baeaffdac26e5b91f
