Include act_rewriter_allow_list and leaf_module in lower (#71289)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/71289
Test Plan:
Facebook
buck test mode/opt -j 10 caffe2/test/fx2trt/trt_lower:test_fx2trt_lower
Reviewed By: 842974287
Differential Revision: D33556639
fbshipit-source-id: feda71ce08690b85576fc43a18e670fe94beaa91
(cherry picked from commit 6c8efc264fa378c06d1deb5259d91d237b000d53)
