Disable some unsupported module for 32-bit build (#38950)
Summary:
Fixes https://github.com/pytorch/pytorch/issues/38322#issuecomment-632976523 and https://github.com/pytorch/pytorch/issues/38322#issuecomment-628698852.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/38950
Differential Revision: D21721918
Pulled By: ezyang
fbshipit-source-id: 999788bb88d3e3c2c06f8dec4f0d6b3389095936
