Implement usage of `is_shardable` and `apply_sharding` (#61236)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/61236
Test Plan: Imported from OSS
Reviewed By: ejguan
Differential Revision: D29588835
Pulled By: VitalyFedyunin
fbshipit-source-id: 00c3042f96af498637b2dcf6e3f842c1fc05ddd8
