Revert "Retry download and install NDK when testing Android (#97067)"
This reverts commit d9b289b74749f76ea9a8c27e74fb60251ff42a66.
Reverted https://github.com/pytorch/pytorch/pull/97067 on behalf of https://github.com/huydhn due to Need to rework this a bit as sdkmanager does not correctly treat a failed download as failure (surprise) https://github.com/pytorch/pytorch/actions/runs/4495666042/jobs/7909537961
