move intrusive_ptr benchmark to shared build structure (#71413)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/71413
ghstack-source-id: 150235101
Test Plan: Verified manually. Rely on CI to validate.
Reviewed By: malfet
Differential Revision: D33635740
fbshipit-source-id: 82c6798a20c01c16fb17547d4a0ba30e6ffc272d
(cherry picked from commit d7a0b39f510f59fe16f138a712d380e0091b230a)
