[LTC] Sync LazyGraphExecutor and LazyTensor with the staging branch (#70867)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/70867
This commit syncs LazyGraphExecutor and LazyTensor with the staging branch's
latest changes.
Test Plan: CI in the lazy_tensor_staging branch.
Reviewed By: wconstab, desertfire
Differential Revision: D33440005
Pulled By: alanwaketan
fbshipit-source-id: 0dd72643dbf81a87fc4b05019b6564fcb28f1979
