Back out "Revert D21581908: Move TensorOptions ops to c10" (#40595)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/40595
ghstack-source-id: 106691774
Test Plan: waitforsandcastle
Differential Revision: D22247729
fbshipit-source-id: 14745588cae267c1e0cc51cd9541a9b8abb830e5
