xla
Use Ansible for building wheels and provisioning docker images.
#4531
Merged
Overview
Commits
41
Changes
View On GitHub

Use Ansible for building wheels and provisioning docker images. #4531

mateuszlewko merged 41 commits into pytorch:master from mateuszlewko:ansible
mateuszlewko
Add basic ansible configuration for bazel and installing apt pkgs
de88ad17
Add apt repos and some signing keys
24e4baff
mateuszlewko Add pip packages
a514d19d
mateuszlewko Don't use apt-key for adding repo keys
4e8cfb24
mateuszlewko Don't use apt-key for adding repo keys
1be9ba75
mateuszlewko Add fetch_srcs role for fetching PyTorch and XLA repos
9613b090
mateuszlewko Add patches application
3187aed3
mateuszlewko Add role for compling PyTorch and XLA sources
6f595121
mateuszlewko WIP in build srcs
50eafb36
mateuszlewko Succesfully build XLA
f211dce8
mateuszlewko Clean-up and merge env variables; Separate stage; arch and accelerato…
0890c584
mateuszlewko Fix passing env variables; Add missing XLA_SANDBOX_BUILD
d9591e50
mateuszlewko Rename playbooks dir to ansible
50cf442a
mateuszlewko Add cloudbuild file that uses ansible playbook
56dfbe2a
mateuszlewko Add 'signed-by' to all apt repos
a319f14b
mateuszlewko Add placeholders for release config vars
31d6c22e
mateuszlewko Add release build
d298a416
mateuszlewko Disable verbose ansible in docker build
c59b3cb9
mateuszlewko Add ansible config file and enable displaying tasks duration
96fbb5f8
mateuszlewko Add TORCH_XLA_VERSION env variable, which is used when building XLA
2be17cd3
mateuszlewko Disable Ansible warnings about no inventory; Force git clone; revert …
642bc8e9
mateuszlewko Add basic tests for bazel and fetch_srcs roles
28fa5cdc
mateuszlewko Add import tests for build_srcs
bcda96e8
mateuszlewko Set git versions for which imports work
ea4d548a
mateuszlewko Pass env vars to imports test
a79495d4
mateuszlewko Add configure_env role and apply minor cleanup
271c90cc
mateuszlewko Don't replace existing env var entries in /etc/environment
b88d1697
mateuszlewko Merge branch 'pytorch:master' into master
f5ba73f9
mateuszlewko Move ansible dir to /docker/experimental
b6892c19
mateuszlewko Remove vars_prompt so that the playbook is not interactive
074bd49e
mateuszlewko Shorten variable validation error message
e673729b
mateuszlewko Add readme file; cleanup some variables
281c4aac
mateuszlewko Change git revisions to head
c7ded27f
mateuszlewko mateuszlewko marked this pull request as ready for review 2 years ago
mateuszlewko Remove variable from task name that's not substituted
c053a5bc
JackCaoG
JackCaoG JackCaoG requested a review from JackCaoG JackCaoG 2 years ago
JackCaoG JackCaoG requested a review from will-cromar will-cromar 2 years ago
JackCaoG JackCaoG requested a review from steventk-g steventk-g 2 years ago
stgpetrovic stgpetrovic requested a review from stgpetrovic stgpetrovic 2 years ago
stgpetrovic
stgpetrovic commented on 2023-02-08
stgpetrovic
stgpetrovic commented on 2023-02-08
steventk-g
steventk-g commented on 2023-02-07
will-cromar
will-cromar commented on 2023-02-08
mateuszlewko Fix link formatting in README.md
0d6c8a7f
mateuszlewko Append env variables to bashrc and zshrc instead of /etc/environment
a5d36dec
mateuszlewko Bump cuda packages version; add sympy
666df60d
mateuszlewko Downgrade to clang-10
13b36a31
mateuszlewko Remove libomp5
00ce2bfc
mateuszlewko Set correct version for libcudnn8
7124a8cf
JackCaoG
mateuszlewko Merge branch 'pytorch:master' into ansible
fb0b9f48
will-cromar
will-cromar approved these changes on 2023-02-22
mateuszlewko mateuszlewko merged 8b3fc227 into master 2 years ago
mateuszlewko mateuszlewko deleted the ansible branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum