jax
2f6cb89a - Add a private property to NamedSharding called `_logical_device_ids` which allows you to pass a custom `tile_assignment_devices()` equivalent.

Commit
1 year ago
Add a private property to NamedSharding called `_logical_device_ids` which allows you to pass a custom `tile_assignment_devices()` equivalent. This is because for Shardy, GSPMDSharding doesn't work, so `device_put` on a mesh with different device order needs `NamedSharding` support. Bonus is that the logic is now simplified wrt the previous version in `_different_device_order_reshard`. This will also allow us to remove OpSharding usage in other projects which require such kind of permutation capabilities. PiperOrigin-RevId: 685925636
Author
Parents
Loading