pytorch

0604b45f - pytorch android circleci integration (#25286)

pytorch android circleci integration (#25286) Summary: Introducing circleCI jobs for pytorch_android gradle builds, the ultimate goal of it at the moment - to run: ``` gradle assembleRelease -p ~/workspace/android/pytorch_android assembleRelease ``` To assemble android gradle build (aar) we need to have results of libtorch-android shared library with headers for 4 android abis, so pytorch_android_gradle_build requires 4 jobs ``` - pytorch_android_gradle_build: requires: - pytorch_linux_xenial_py3_clang5_android_ndk_r19c_x86_32_build - pytorch_linux_xenial_py3_clang5_android_ndk_r19c_x86_64_build - pytorch_linux_xenial_py3_clang5_android_ndk_r19c_arm_v7a_build - pytorch_linux_xenial_py3_clang5_android_ndk_r19c_arm_v8a_build ``` All jobs use the same base docker_image, differentiate them by committing docker images with different android_abi -suffixes (like it is now for xla and namedtensor): (it's in `&pytorch_linux_build_defaults`) ``` if [[ ${BUILD_ENVIRONMENT} == *"namedtensor"* ]]; then export COMMIT_DOCKER_IMAGE=$output_image-namedtensor elif [[ ${BUILD_ENVIRONMENT} == *"xla"* ]]; then export COMMIT_DOCKER_IMAGE=$output_image-xla elif [[ ${BUILD_ENVIRONMENT} == *"-x86"* ]]; then export COMMIT_DOCKER_IMAGE=$output_image-android-x86 elif [[ ${BUILD_ENVIRONMENT} == *"-arm-v7a"* ]]; then export COMMIT_DOCKER_IMAGE=$output_image-android-arm-v7a elif [[ ${BUILD_ENVIRONMENT} == *"-arm-v8a"* ]]; then export COMMIT_DOCKER_IMAGE=$output_image-android-arm-v8a elif [[ ${BUILD_ENVIRONMENT} == *"-x86_64"* ]]; then export COMMIT_DOCKER_IMAGE=$output_image-android-x86_64 else export COMMIT_DOCKER_IMAGE=$output_image fi ``` pytorch_android_gradle_build job copies headers and libtorch.so, libc10.so results from libtorch android docker images, to workspace first and to android_abi=x86 docker image afterwards, to run there final gradle build calling `.circleci/scripts/build_android_gradle.sh` For PR jobs we have only `pytorch_linux_xenial_py3_clang5_android_ndk_r19c_x86_32_build` libtorch android build => it will have separate gradle build `pytorch_android_gradle_build-x86_32` that does not do docker copying, it calls the same `.circleci/scripts/build_android_gradle.sh` which has only-x86_32 logic by condition on BUILD_ENVIRONMENT: `[[ "${BUILD_ENVIRONMENT}" == *-gradle-build-only-x86_32* ]]` And has filtering to un only for PR as for other runs we will have the full build. Filtering checks `-z "${CIRCLE_PULL_REQUEST:-}"` ``` - run: name: filter_run_only_on_pr no_output_timeout: "5m" command: | echo "CIRCLE_PULL_REQUEST: ${CIRCLE_PULL_REQUEST:-}" if [ -z "${CIRCLE_PULL_REQUEST:-}" ]; then circleci step halt fi ``` Updating docker images to the version with gradle, android_sdk, openjdk - jenkins job with them https://ci.pytorch.org/jenkins/job/pytorch-docker-master/339/ pytorch_android_gradle_build successful run: https://circleci.com/gh/pytorch/pytorch/2604797#artifacts/containers/0 pytorch_android_gradle_build-x86_32 successful run: https://circleci.com/gh/pytorch/pytorch/2608945#artifacts/containers/0 Pull Request resolved: https://github.com/pytorch/pytorch/pull/25286 Reviewed By: kostmo Differential Revision: D17115861 Pulled By: IvanKobzarev fbshipit-source-id: bc88fd38b38ed0d0170d719fffa375772bdea142