changes to apply xla patch (#16781)
Summary:
This PR will let xla tests passes after https://github.com/pytorch/xla/pull/183 is in.
Will add back the branch filters once it's ready.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/16781
Differential Revision: D13968976
Pulled By: ailzhang
fbshipit-source-id: df3b173336b3247aa56ef723569a1f68cdfa56e0
