.circleci: Explicitly remove nvidia apt repos (#41367)
Summary:
The nvidia apt repositories seem to be left over on the amd nodes so
let's just go ahead and remove them explicitly if we're not testing for
CUDA
Example: https://app.circleci.com/pipelines/github/pytorch/pytorch/190222/workflows/8f75b5cd-1afd-43dc-9fa7-f7b058f07b46/jobs/6223743/steps
Signed-off-by: Eli Uriegas <eliuriegas@fb.com>
Pull Request resolved: https://github.com/pytorch/pytorch/pull/41367
Reviewed By: ezyang
Differential Revision: D22513844
Pulled By: seemethere
fbshipit-source-id: 6da4dd8423de5f7ec80c7904187cf80c1b91ab14
