Test if allocator is set only in DEBUG mode. (#51360)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/51360
Invariant should be satisfied by call sites of allocator
ensuring that the device type makes sense.
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Test Plan: Imported from OSS
Reviewed By: swolchok
Differential Revision: D26170202
Pulled By: ezyang
fbshipit-source-id: f23681f34187c0d3da794f7a8c869ea8da88365d
