Revert D33480077: .github: Re-enable xla test config
Test Plan: revert-hammer
Differential Revision:
D33480077 (https://github.com/pytorch/pytorch/commit/18e1e1d4d333f5ab2f5da67c80769d1752360140)
Original commit changeset: a2e720c55d0e
Original Phabricator Diff: D33480077 (https://github.com/pytorch/pytorch/commit/18e1e1d4d333f5ab2f5da67c80769d1752360140)
fbshipit-source-id: e4e114a9a6d7940491ac0741e94f455a490f077a
