ci: Remove CUDA 11.1 binary builds
These builds weren't advertised on our websites and we've confirmed that
CUDA 11.3 binaries are forwards compatible with CUDA 11.1 drivers.
Signed-off-by: Eli Uriegas <eliuriegasfb.com>
Pull Request resolved: https://github.com/pytorch/pytorch/pull/73376
