Fix meta load tensor imcompatible issue (#7073)
The partition tensor doesn't need to move to the current device when
meta load is used.
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Signed-off-by: Logan Adams <loadams@microsoft.com>
