Fix bug where frozen mod not used for OFI #68903 (#71436)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/71436
Fixes issue #68903
Test Plan: Imported from OSS
Reviewed By: george-qi
Differential Revision: D33824857
Pulled By: Gamrix
fbshipit-source-id: 8d351feb4a621916f55003c58527a1e85eec476e
(cherry picked from commit 57bb4200403692adee1c09f22ce02b1534bad202)
