Revert "Add a workflow to cache third party dependencies on S3 (#83306)"
This reverts commit 0961dd6e9981fe6580ee3f1d2c622f526d8ab9a9.
Reverted https://github.com/pytorch/pytorch/pull/83306 on behalf of https://github.com/huydhn due to The fix in https://github.com/pytorch/pytorch/pull/83489 still doesn't work
