Remove some unused variables (#60411)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/60411
Test Plan: Sandcastle
Reviewed By: ngimel
Differential Revision: D29221207
fbshipit-source-id: da6ad44036291a98f0b36b260062d077a7c2691b
