Fix incorrect usage of CUDACachingAllocator [v2] (#48817)
Summary:
This is similar to https://github.com/pytorch/pytorch/issues/46605, where the c10::complex part of the code was not merged yet at that moment.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/48817
Reviewed By: malfet
Differential Revision: D25333179
Pulled By: ezyang
fbshipit-source-id: a92bdad5ad4b36bef7f050b21a59676c38e7b1fc