.circleci: Remove macOS builds related to CUDA (#34333)
Summary:
We don't release binaries for macOS with CUDA support so we should just
remove it from our regular PR pipeline
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>
Pull Request resolved: https://github.com/pytorch/pytorch/pull/34333
Differential Revision: D20312565
Pulled By: seemethere
fbshipit-source-id: 376228680aa0e814d1b37f1ff63b7d1262515e44
