Enable AutoGradMode in InferenceMode. (#56107)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/56107
Test Plan: Imported from OSS
Reviewed By: pbelevich, driazati
Differential Revision: D27807137
Pulled By: ailzhang
fbshipit-source-id: bfacf11ec5a431589cec73d6371cac81b425a115
