.circleci: Only run macos libtorch on master (#32378)
Summary:
These jobs were taking forver to run so we decided it's only really
worth it to run it on master.
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>
Pull Request resolved: https://github.com/pytorch/pytorch/pull/32378
Differential Revision: D19499301
Pulled By: seemethere
fbshipit-source-id: 22cac5b5baee84e44607a16daeb77048cb0f5974
