Move the pin to latest to unbreak the xla CI (#93000)
This should unbreak the XLA CI since we disabled the failing test on our end.
@malfet
Pull Request resolved: https://github.com/pytorch/pytorch/pull/93000
Approved by: https://github.com/huydhn, https://github.com/ZainRizvi
