remove unneeded code (#26640)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/26640
Remove some code that we forgot to remove before
Test Plan:
python test/test_jit.py
Imported from OSS
Differential Revision: D17538669
fbshipit-source-id: 9614e45f6e5ad6f2fe2b4936deb23d0ffdfcd86a
