pytorch
6acd87fe - Add driver function to run test_sharded_tensor.py and test_sharding_spec.py (#63189)

Commit
3 years ago
Add driver function to run test_sharded_tensor.py and test_sharding_spec.py (#63189) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/63189 Add main --> run_tests func in test file which is needed to launch the real test cases in OSS flow. Test Plan: b/f: $ python test/distributed/_sharding_spec/test_sharding_spec.py --v ==> nothing happened $ python test/distributed/_sharded_tensor/test_sharded_tensor.py --v ==> nothing happened after: $ python test/distributed/_sharding_spec/test_sharding_spec.py --v ==> test_chunked_sharding_spec (__main__.TestShardingSpec) ... ok test_device_placement (__main__.TestShardingSpec) ... ok test_enumerable_sharding_spec (__main__.TestShardingSpec) ... ok $ python test/distributed/_sharded_tensor/test_sharded_tensor.py --v test_complete_world_size (__main__.TestShardedTensorChunked) ... ok test_insufficient_sharding_dims (__main__.TestShardedTensorChunked) ... ok test_invalid_pg_rpc_ranks (__main__.TestShardedTensorChunked) ... [W tensorpipe_agent.cpp:699] RPC agent for worker2 encountered error when reading incoming request from worker0: eof (this error originated at tensorpipe/transport/shm/connection_impl.cc:259) ok test_invalid_sharding (__main__.TestShardedTensorChunked) ... ok test_load_state_dict_errors (__main__.TestShardedTensorChunked) ... ok test_multiple_local_shards (__main__.TestShardedTensorChunked) ... ok test_new_group (__main__.TestShardedTensorChunked) ... ok test_partial_world_size (__main__.TestShardedTensorChunked) ... ok test_sharded_tensor_metadata (__main__.TestShardedTensorChunked) ... ok test_sharded_tensor_sizes (__main__.TestShardedTensorChunked) ... ok test_sharding_columns (__main__.TestShardedTensorChunked) ... ok test_state_dict (__main__.TestShardedTensorChunked) ... ok test_state_dict_new_group (__main__.TestShardedTensorChunked) ... ok test_state_dict_no_sharded_tensors (__main__.TestShardedTensorChunked) ... ok test_grid_sharding (__main__.TestShardedTensorEnumerable) ... ok test_multiple_local_shards (__main__.TestShardedTensorEnumerable) ... ok test_new_group (__main__.TestShardedTensorEnumerable) ... ok test_partial_world_size (__main__.TestShardedTensorEnumerable) ... ok test_sharded_tensor_metadata (__main__.TestShardedTensorEnumerable) ... ok test_uneven_shards (__main__.TestShardedTensorEnumerable) ... ok test_with_rpc_names (__main__.TestShardedTensorEnumerable) ... ok test_init_from_local_shards (__main__.TestShardedTensorFromLocalShards) ... ok test_init_from_local_shards_invalid_shards (__main__.TestShardedTensorFromLocalShards) ... ok test_init_from_local_shards_invalid_shards_gaps (__main__.TestShardedTensorFromLocalShards) ... Imported from OSS Reviewed By: VitalyFedyunin Differential Revision: D30294094 fbshipit-source-id: 08f0431a12ea854abe00dc920205b10ba43ae6b6
Author
Parents
Loading