Revert "Update singleton int to error when inequality relation is undefined (#110044)"
This reverts commit 07331c65e6b47f41475fc0d81ba03917f39b55dd.
Reverted https://github.com/pytorch/pytorch/pull/110044 on behalf of https://github.com/PaliC due to bottom diff is causing a plethora of internal failures ([comment](https://github.com/pytorch/pytorch/pull/110044#issuecomment-1749805209))