Revert "Force upsample to be float32 (#121324)"
This reverts commit 2770e3addd9f05101705f0fef85a163e0034b8a5.
Reverted https://github.com/pytorch/pytorch/pull/121324 on behalf of https://github.com/huydhn due to I think it is better to revert and reland this next week https://hud.pytorch.org/pytorch/pytorch/commit/2770e3addd9f05101705f0fef85a163e0034b8a5 ([comment](https://github.com/pytorch/pytorch/pull/121324#issuecomment-2000617536))
