Get rid of more unused plugins.
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/25355
Test Plan: Imported from OSS
Reviewed By: ezyang
Differential Revision: D17101578
Pulled By: gchanan
fbshipit-source-id: aef433771b6420c09394276b8f73396dd4f305fb
