Fix TestBufferProtocolCPU::test_byte_to_int_cpu test on Big Endian (#96424)
Fix TestBufferProtocolCPU::test_byte_to_int_cpu test on Big Endian
Pull Request resolved: https://github.com/pytorch/pytorch/pull/96424
Approved by: https://github.com/janeyx99
