Autograd code clean up (#43167)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/43167
Test Plan: Imported from OSS
Reviewed By: mruberry
Differential Revision: D23222358
Pulled By: anjali411
fbshipit-source-id: b738c63b294bcee7d680fa64c6300007d988d218
