xla

7f96fbf6 - Pin all layout by default and use all_reduce based all_gather when la… (#3568)

Pin all layout by default and use all_reduce based all_gather when la… (#3568) * Pin all layout by default and use all_reduce based all_gather when layout is pin * Only using all_reduce to implement all_gather for TPU and GPU * fix typo