pytorch
bd1e95ce - Improve the performance of validate_non_overlapping_shards_metadata (#85639)

Commit
2 years ago
Improve the performance of validate_non_overlapping_shards_metadata (#85639) `validate_non_overlapping_shards_metadata()` uses a quadratic algorithm to verify the overlapping. However, in some cases (only one dimension is sharded), we a O(nlogn) algorithm can easily be implemented. This PR changes the implementation of `validate_non_overlapping_shards_metadata()`. Differential Revision: [D39681725](https://our.internmc.facebook.com/intern/diff/D39681725/) Pull Request resolved: https://github.com/pytorch/pytorch/pull/85639 Approved by: https://github.com/wanchaol
Author
Committer
Parents
Loading