[PyTorch BC] Clean up whitelist (#35730)
Summary:
Remove stale items
Pull Request resolved: https://github.com/pytorch/pytorch/pull/35730
Reviewed By: hl475
Differential Revision: D20754058
Pulled By: houseroad
fbshipit-source-id: 5f38b34ad68bd7cb6db8cf1654424d655436ca35
