xla
Add reduce-scatter coalescing for FSDP/ZeRO1
#5956

Merged

Commits

Add reduce-scatter coalescence support for FSDP.

jeffhataws committed 2 years ago
Fix error checking when input is list and output is specified

jeffhataws committed 2 years ago
Add reduce-scatter test with list of tensors as input/output

jeffhataws committed 2 years ago
For now, error when reduce-scatter coaelesce xm API is used with output!=None

Arjunbala committed 2 years ago