Revert "Use UnaryUfuncInfo for type conversion functions (#82349)"
This reverts commit 13e78a2cb9f203a71b165b31c39e074394ab57f3.
Reverted https://github.com/pytorch/pytorch/pull/82349 on behalf of https://github.com/peterbell10 due to This stack broke macos tests on trunk
