Close some sources of fake tensor leakage
Summary:
X-link: https://github.com/pytorch/pytorch/pull/161589
cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames Lucaskabela
imported-using-ghimport
Reviewed By: avikchaudhuri
Differential Revision: D81100936
Pulled By: tugsbayasgalan
fbshipit-source-id: 0bda19cd113c64274b69dc391781a2acf29e484f
