xla
Add Terraform config with CloudBuild triggers for building docker images and wheels
#4604
Merged
Merged
Add Terraform config with CloudBuild triggers for building docker images and wheels #4604
mateuszlewko
merged
100 commits into
master
from
mlewko/cloudbuild
Add basic ansible configuration for bazel and installing apt pkgs
f2245402
Add apt repos and some signing keys
8b9f75ec
Add pip packages
e4b1d148
Don't use apt-key for adding repo keys
83f03a48
Don't use apt-key for adding repo keys
ae5bd04a
Add fetch_srcs role for fetching PyTorch and XLA repos
9e20eff0
Add patches application
23edf5f6
Add role for compling PyTorch and XLA sources
962af4f3
WIP in build srcs
e42b986a
Succesfully build XLA
12cdf8d7
Clean-up and merge env variables; Separate stage; arch and accelerato…
06f95550
Fix passing env variables; Add missing XLA_SANDBOX_BUILD
756cc26a
Rename playbooks dir to ansible
524cfb66
Add cloudbuild file that uses ansible playbook
aa28b5a2
Add 'signed-by' to all apt repos
9dafb224
Add placeholders for release config vars
eb5e81d0
Add release build
02dd57bb
Disable verbose ansible in docker build
fd97bb08
Add ansible config file and enable displaying tasks duration
267672fa
Add TORCH_XLA_VERSION env variable, which is used when building XLA
4e3676de
Disable Ansible warnings about no inventory; Force git clone; revert …
dd8ecec2
Add basic tests for bazel and fetch_srcs roles
ca16d26c
Add import tests for build_srcs
86b6b6fb
Set git versions for which imports work
c79b4513
Pass env vars to imports test
ae831500
Add configure_env role and apply minor cleanup
a443d13e
Don't replace existing env var entries in /etc/environment
44ca33ae
Move ansible dir to /docker/experimental
2a3170f1
Minor
80978492
Add cloudbuild file that builds tpu wheels and dev/release docker images
4b3eb799
Add initial Terraform configuration with bucket for storing state
95938b0e
Add Google Cloud bucket for wheels
3777a718
Add cloudbuild trigger for dev image
0cb6c8be
Remove TF state backup
8e20adb6
Add missing ansible install in release image dockerfile
4aa8fb5d
Add a step to build release image and wheels
c34fd6cb
Rever prev change
94fd4345
Add ids to buildsteps
6a99df92
Add artifacts repo and public permissions for the wheels bucket
ecf55787
Provision worker pool
7a57a1ff
Correct docker repo url
14aa5a88
Add trigger for release images
fb085f4f
Minor fixes to release image trigger
3a4fefe7
Use trigger name instead of id in cloud scheduler job
b6e70b1b
Push wheels from release-image-trigger to wheels bucket
075952c3
Add some outputs
cf01e1e3
Add a todo for wheels naming
0321c16f
Correct the list of artifacts for release_images
0ff3559e
Propagate cloudbuild triggers from docker_images variable.
7f61c1ef
Add dir parameter
8af004a2
Add -c before docker args
b466327e
Fix docker_images build args
6c4c79ec
Pass build args for development image
0bfe8b88
Add many docker images
bb6435e6
Remove unused cloudbuild file
c69a03dc
Pass pytorch and xla git revs to ansible
7da3dfa4
Remove -trigger suffix
b30aba24
Set proper name to triggers
afa66cd8
Complete readme file
9cfa91cf
Include build logs with github status
5d4ab4c3
Set object only if there are any wheels specified
d269fa6a
Add trigger for release images
f09ec161
Reduce the number of explicit variables for docker images
3b65e245
Rename name paramter to trigger_name
c8036d7c
Add 6h timeout to cloud builds
a5ff1be8
Move terraform_cloudbuild to terraform
4d7891d6
Disable clang
a4ab9dc7
Add trigger for XLA 2.0 on TPUVM
2c3ecaf0
Add --progress=plain to docker builds
e6e292e5
Set gcc and g++ explicitly
1b791afa
Remove Python 3.7 build trigger from Terraform (#4534)
88ae5749
Use Ansible for building wheels and provisioning docker images. (#4531)
c82b626b
Add cloudbuild file that builds tpu wheels and dev/release docker images
347c7b17
Add trigger for release images
c97dc335
Move terraform_cloudbuild to terraform
5eb45572
Rebase fix
51614c9f
Add cuda_version to ansible vars
d5c51e82
Increase verbosity of ansible playbook
0e690445
Use e2-standard-32 for staging worker pool
1fabfd2d
Pass git revs to build stage of ansible playbook
d46f9d06
Fix passing extra args to ansible
b1cdde50
Add missing docker build file args
32ae9df3
Wrap cuda version in quotes to ensure they're treated as string
61427343
Set xla_git_rev to HEAD for v2.0 build
f2375a23
Fix wrong rebase
e0e26408
Pass package version to ansible config
2207f853
Set cuda_version to string
7fe81151
Add debug statement for listing generated wheels
e525c781
Add trigger for release images
f09ec161
Add --progress=plain to docker builds
e6e292e5
Set xla_git_rev to HEAD for v2.0 build
f2375a23
Debugging artifacts
1a1d9007
Fixed uploading wheels to storage bucket
54985332
Use tag v2.0.0 for xla sources
f97b74e2
Use master branch for ansible setup version in all triggers
026af0c3
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub