Remove tools directory after checking it is in the expected location. (#979)
Summary:
Update the workaround to https://github.com/facebookresearch/detectron2/issues/3934
Pull Request resolved: https://github.com/pytorch/benchmark/pull/979
Reviewed By: erichan1
Differential Revision: D37319582
Pulled By: xuzhao9
fbshipit-source-id: 468b9cdc9050e617312edb20f7bc0e4cc7446c25