[resubmit] Remove sync for randperm on small tensors. (#54113) (#57364)
Summary:
- [x] check MaskRCNN
Pull Request resolved: https://github.com/pytorch/pytorch/pull/57364
Reviewed By: anjali411
Differential Revision: D28166385
Pulled By: ngimel
fbshipit-source-id: 42804b52cc837a95fc1d7ea49b430b55598be7bb
