fix InplaceOrView implementation for manual functions (#57152)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/57152
Test Plan: Imported from OSS
Reviewed By: zou3519
Differential Revision: D28071506
Pulled By: albanD
fbshipit-source-id: ef015593dd81be11bc08714d07e0ac4f26e188ec
