Revert "Update XLA pin (#121501)"
This reverts commit 9d83f9dc0e4535f6535389201bc3c4a37f3305e3.
Reverted https://github.com/pytorch/pytorch/pull/121501 on behalf of https://github.com/malfet due to We are trying to revert underlying change first ([comment](https://github.com/pytorch/pytorch/pull/121501#issuecomment-1986289409))
