[PyTorch] Use castRaw in InterfaceType (#66728)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/66728
Two extra refcount bumps.
ghstack-source-id: 140760872
Test Plan: CI
Reviewed By: suo
Differential Revision: D31698577
fbshipit-source-id: 1f50195a99f98f857abc9b03b4254519c316fefe
