[PyTorch BC] Clean up the whitelist for PyTorch Op BC check (#32523)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/32523
remove stale items
Test Plan: cont build
Reviewed By: hl475
Differential Revision: D19526918
fbshipit-source-id: ee7392ae84e5ddf88284020775119e59c9b6533e
