Revert "Land "Make ceil,floor,round,trunc handle integers" (#85144)"
This reverts commit b27eb8d377fc8ac267fdaed7f95a03d609764604.
Reverted https://github.com/pytorch/pytorch/pull/85144 on behalf of https://github.com/clee2000 due to broke slow tests in trunk ex https://ossci-raw-job-status.s3.amazonaws.com/log/8433956087
