Miscellaneous follow up for code review comments (#29204)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/29204
Code review comments from #28620
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Test Plan: Imported from OSS
Differential Revision: D18353506
Pulled By: ezyang
fbshipit-source-id: 0432ce513eff257fd85cddff8bc3e41935127ed8
