Reduce binary size of schema inference (#34735)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/34735
ghstack-source-id: 102255215
Test Plan: testinprod
Differential Revision: D20448172
fbshipit-source-id: 1e5580c9e7eb3626420fc1a06acef072586438a7
