Add efficient zero tensors (#64837)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/64837
Test Plan: Imported from OSS
Reviewed By: albanD
Differential Revision: D32144240
Pulled By: anjali411
fbshipit-source-id: d44096d882657c7f9270a16636900e0b73cefa40