Defer importing meta_table (#87630)
This is needed to work around an internal test failure: https://www.internalfb.com/tasks/?t=135878641
Pull Request resolved: https://github.com/pytorch/pytorch/pull/87630
Approved by: https://github.com/eellison, https://github.com/khabinov
