Optionally run fbgemm in tracer (#83531)
Summary: Well this tech debt has come back to haunt me. Gonna slap more duct-tape on it for today.
Test Plan: ci
Differential Revision: D38753249
Pull Request resolved: https://github.com/pytorch/pytorch/pull/83531
Approved by: https://github.com/dhruvbird
