Remove more build options not needed to be explicitly set in Python build scripts. (#22153)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/22153
ghimport-source-id: 129d90626a8e64079477a744fbbaba58e139a852
Test Plan: Imported from OSS
Differential Revision: D15985375
Pulled By: ezyang
fbshipit-source-id: 925bb1c886633b002beb1da0754bb055aa971e21
