Remove cuda 11.5 builds since we have 11.6
CUDA 11.5 was experimental, but now that we are moving to 11.6, we don't need to keep 11.5 around.
Please note following PR's where merged for domain libraries
[vision](https://github.com/pytorch/vision/pull/5862)
[audio](https://github.com/pytorch/audio/pull/2346)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/76257
Approved by: https://github.com/seemethere, https://github.com/malfet