Clean up backward compatibility skip list (#49691)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/49691
Quite a few stale items, let's make the list short.
Test Plan: oss ci
Reviewed By: hl475
Differential Revision: D25667464
fbshipit-source-id: cff1be8b5e0068470b3f621acf6bf4fbd414233e
