Binary building wthout python fix (#66031)
Summary:
Fixes https://github.com/pytorch/pytorch/issues/66030
Pull Request resolved: https://github.com/pytorch/pytorch/pull/66031
Reviewed By: VitalyFedyunin
Differential Revision: D31356243
Pulled By: malfet
fbshipit-source-id: d1537bc65bbba5d6497ecb8db7160a397eca81fd
