Add efficient zero tensors (#64837)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/64837
Test Plan: Imported from OSS
Reviewed By: gchanan
Differential Revision: D32834987
Pulled By: anjali411
fbshipit-source-id: 20ea08ade0db0044ca633d9c1a117a6a2e65d1fd
