xla
Functionalization integration
#4158
Merged

Functionalization integration #4158

alanwaketan merged 130 commits into master from functionalization
bdhirsh
JackCaoG
bdhirsh bdhirsh force pushed from 348ba86e to 6b694e08 3 years ago
bdhirsh
wonjoo-wj wonjoo-wj force pushed from 6b694e08 to 28a6a796 3 years ago
wonjoo-wj wonjoo-wj marked this pull request as draft 3 years ago
wonjoo-wj wonjoo-wj force pushed from 68ba20b2 to 8c460ab5 3 years ago
wonjoo-wj
wonjoo-wj wonjoo-wj force pushed from 39583b30 to 179ac8bf 3 years ago
wonjoo-wj
wonjoo-wj wonjoo-wj force pushed from 179ac8bf to 07d072cd 3 years ago
wonjoo-wj wonjoo-wj force pushed from 07d072cd to 022a67fc 3 years ago
alanwaketan
wonjoo-wj wonjoo-wj force pushed from 022a67fc to 6305d934 3 years ago
wonjoo-wj wonjoo-wj force pushed from 6305d934 to 4e3c5080 3 years ago
wonjoo-wj wonjoo-wj force pushed from 4e3c5080 to 4bcbbad6 3 years ago
wonjoo-wj wonjoo-wj force pushed from 4bcbbad6 to fa96188d 3 years ago
wonjoo-wj
wonjoo-wj wonjoo-wj force pushed from fa96188d to 90e7bc8b 3 years ago
wonjoo-wj wonjoo-wj force pushed from 90e7bc8b to a81964fc 3 years ago
wonjoo-wj wonjoo-wj force pushed from 4cfe2dae to 61a6426e 3 years ago
wonjoo-wj wonjoo-wj force pushed from 61a6426e to 9e5f1411 3 years ago
wonjoo-wj wonjoo-wj force pushed from a5684ce8 to dc3ed923 3 years ago
alanwaketan
wonjoo-wj wonjoo-wj force pushed from ae482b48 to 50097743 3 years ago
alanwaketan
alanwaketan commented on 2022-12-16
alanwaketan
alanwaketan commented on 2022-12-16
wonjoo-wj
alanwaketan
wonjoo-wj
wonjoo-wj wonjoo-wj force pushed from b354d345 to c8ef117a 3 years ago
wonjoo-wj wonjoo-wj force pushed from c8ef117a to 4cf2f8a7 3 years ago
wonjoo-wj wonjoo-wj force pushed from 4cf2f8a7 to 1448f006 3 years ago
wonjoo-wj wonjoo-wj force pushed from 1448f006 to 9db9c2c7 3 years ago
wonjoo-wj wonjoo-wj force pushed from 9db9c2c7 to 5049c9ba 3 years ago
wonjoo-wj wonjoo-wj force pushed from c16caa16 to 6797739f 3 years ago
alanwaketan
alanwaketan commented on 2022-12-20
wonjoo-wj wonjoo-wj force pushed from c17aac9b to 0d2dcd3b 3 years ago
alanwaketan alanwaketan force pushed from 5cbda157 to 8ac68445 3 years ago
wonjoo-wj wonjoo-wj force pushed from 9e62f717 to deb146ee 3 years ago
wonjoo-wj wonjoo-wj force pushed from deb146ee to 1744766d 3 years ago
alanwaketan alanwaketan force pushed from 1744766d to 77713d82 3 years ago
wonjoo-wj wonjoo-wj force pushed from 325a32ff to 51a4d253 3 years ago
wonjoo-wj
wonjoo-wj
alanwaketan
wonjoo-wj
alanwaketan
alanwaketan
alanwaketan alanwaketan force pushed from 11b7ccaf to 9040f32f 3 years ago
alanwaketan
alanwaketan
alanwaketan alanwaketan force pushed from 9040f32f to 052ba745 3 years ago
alanwaketan alanwaketan force pushed from cb035cd4 to 5a2a319c 3 years ago
alanwaketan alanwaketan force pushed from 92d95330 to 2dbbe01e 3 years ago
wonjoo-wj wonjoo-wj force pushed from 6cce4b61 to 15c695c9 3 years ago
wonjoo-wj wonjoo-wj force pushed from 15c695c9 to 7277888f 3 years ago
wonjoo-wj wonjoo-wj force pushed from 1c75e4ca to ae08eb51 3 years ago
vanbasten23 vanbasten23 force pushed from ae08eb51 to 974c3a98 3 years ago
vanbasten23 vanbasten23 force pushed from 974c3a98 to caccc629 3 years ago
wonjoo-wj wonjoo-wj force pushed from 62e8b7f3 to 131a4559 3 years ago
alanwaketan alanwaketan force pushed from 971b6395 to c0a05a82 3 years ago
alanwaketan alanwaketan force pushed from 6658ff64 to e353f5cf 3 years ago
alanwaketan alanwaketan force pushed from 3d27b69f to 6f1c4d14 3 years ago
alanwaketan alanwaketan force pushed from 5bd47432 to d5279998 3 years ago
bdhirsh POC of functionalization integration
110d3275
wonjoo-wj Add debugging print lines
d228571d
wonjoo-wj Run linter
08a6e088
wonjoo-wj Run linter again
2f3dc479
wonjoo-wj Update torch pin
b75adde5
wonjoo-wj Add more debugging lines
ca92a1cc
wonjoo-wj Lower lift and lift_copy ops
a3462c54
wonjoo-wj Update XLATensor namespace calls to tensor_methods
f96fa13b
wonjoo-wj Update pytorch_test_base.py
8c87e51c
wonjoo-wj Disable failing tests for now
e39d8255
wonjoo-wj Update lift_fresh ops
ff5d44f7
alanwaketan PoC for detach_copy
f05dcb97
alanwaketan Refine the comment
1a0c55f2
bdhirsh POC of functionalization integration
f082f286
wonjoo-wj Add debugging print lines
511cd7d7
wonjoo-wj Run linter
a999a144
wonjoo-wj Run linter again
cbffcacd
wonjoo-wj Update torch pin
2ed5ec24
wonjoo-wj Add more debugging lines
c37ff8b5
wonjoo-wj Update XLATensor namespace calls to tensor_methods
4f1c8bd6
wonjoo-wj Disable more failing tests
c29450b2
wonjoo-wj Run linter
fc227d35
wonjoo-wj Disable more tests
bc57c8f1
wonjoo-wj Clean up some comments
945ce35c
alanwaketan Skip test_empty_strided
a27bfd07
alanwaketan Fix detach_copy
4ad080b1
alanwaketan Skip some test_operations.py tests
558c8ada
wonjoo-wj Enable test_advancedindex_mixed_cpu_devices_xla
4834c26c
wonjoo-wj Remove some comments
4bc241b7
wonjoo-wj Enable test_basic_advanced_combined_xla
b0512b06
alanwaketan Skip test_squeeze_nonzero
70484f49
wonjoo-wj Enable tests in test_embedding and test_pooling
e70093db
alanwaketan error on view op cpu fallback
09c841e9
alanwaketan Fix crash on test_empty_strided
1910a524
alanwaketan Fix index ops
2f38ae0b
alanwaketan Unskip fixed tests
0c76f095
bdhirsh POC of functionalization integration
110d3275
wonjoo-wj Add debugging print lines
d228571d
wonjoo-wj Run linter again
2f3dc479
wonjoo-wj Update torch pin
b75adde5
wonjoo-wj Add more debugging lines
ca92a1cc
wonjoo-wj Lower lift and lift_copy ops
a3462c54
wonjoo-wj Update XLATensor namespace calls to tensor_methods
f96fa13b
wonjoo-wj Update pytorch_test_base.py
8c87e51c
wonjoo-wj Disable failing tests for now
e39d8255
wonjoo-wj Update lift_fresh ops
ff5d44f7
alanwaketan PoC for detach_copy
f05dcb97
alanwaketan Refine the comment
1a0c55f2
bdhirsh POC of functionalization integration
f082f286
wonjoo-wj Add debugging print lines
511cd7d7
wonjoo-wj Run linter
a999a144
wonjoo-wj Run linter again
cbffcacd
wonjoo-wj Update torch pin
2ed5ec24
wonjoo-wj Add more debugging lines
c37ff8b5
wonjoo-wj Update XLATensor namespace calls to tensor_methods
4f1c8bd6
wonjoo-wj Disable more failing tests
c29450b2
wonjoo-wj Run linter
fc227d35
wonjoo-wj Disable more tests
bc57c8f1
wonjoo-wj Clean up some comments
945ce35c
alanwaketan Skip test_empty_strided
a27bfd07
alanwaketan Fix detach_copy
4ad080b1
alanwaketan Skip some test_operations.py tests
558c8ada
wonjoo-wj Enable test_advancedindex_mixed_cpu_devices_xla
4834c26c
wonjoo-wj Remove some comments
4bc241b7
wonjoo-wj Enable test_basic_advanced_combined_xla
b0512b06
alanwaketan Skip test_squeeze_nonzero
70484f49
wonjoo-wj Enable tests in test_embedding and test_pooling
e70093db
alanwaketan Fix crash on test_empty_strided
1910a524
alanwaketan Fix index ops
2f38ae0b
alanwaketan Lower _to_copy
21cf6d5b
alanwaketan unskip test_squeeze_nonzero
bffe20cc
alanwaketan Skip test_squeeze_nonzero as it fails with dynamic shapes
c73c31e6
wonjoo-wj Fix test_affine tests by lowering affine_grid_generator
fc92fff3
wonjoo-wj Move affine_grid_generator to functionalization ops
b1e831eb
wonjoo-wj Delete debugging cout statements
4943c5c8
wonjoo-wj Run linter
d1ebfb3e
wonjoo-wj Lower _euclidean_dist
c68bf5b3
alanwaketan lower copy
ea0ae0b8
alanwaketan Route embeeding to functionalize pass
c66f5854
alanwaketan Lower reshape
2701b654
alanwaketan Introduce xla_expand_outplace
e3a360d7
alanwaketan Route _trilinear to functionalize pass
0cc2e051
alanwaketan lower mvlgamma
382f4dc2
alanwaketan lower masked_scatter
25e21c6c
wonjoo-wj Lower zeros_symint
29b3c5eb
wonjoo-wj Move xla_expand_outplace to tensor_util.h
177f0286
wonjoo-wj Add another xla_expand_outplace function to tensor_util.h to fix inde…
b4dacce0
wonjoo-wj Lower slice.Tensor
fd351730
wonjoo-wj Lower permute.Tensor
79841746
wonjoo-wj Lower select.int
811a4e4a
wonjoo-wj Lower t
2d2d1530
alanwaketan Skip test_nonzero_cast
a41d68f7
wonjoo-wj Disable some more failing tests
6222b03f
wonjoo-wj Disable failing XLA tests
d5642013
wonjoo-wj Enable test_mesh_service.py tests again to expose regression errors
37aecd4e
alanwaketan Skip even more tests
9cea4763
alanwaketan Revert masked_scatter
75c8d0bf
alanwaketan Revert "lower copy"
a4448a35
alanwaketan Revert "Lower zeros_symint"
8c40f3e5
alanwaketan Skip fsdp
138fd9a5
alanwaketan Skip more tests for GPU
7095c540
alanwaketan Adds some counters
398366a4
alanwaketan Fix linters
c2f8a126
alanwaketan Skip test_sizeAdd
8104de9a
alanwaketan Skip test_narrow_copy_non_contiguous
9e10f9f9
wonjoo-wj Run linter
1a69e3cb
wonjoo-wj Disable new dynamo tests that fail with functionalization
872badc2
wonjoo-wj Skip more spmd tests
c8533fe9
wonjoo-wj Set CONTINUE_ON_ERROR=true for testing
9734fcf3
alanwaketan Disable cpp tests
a6a9be9c
alanwaketan Disable Keep Going
d3466c37
alanwaketan [Functionalization] Enable cpp tests (#4462)
7f93346f
wonjoo-wj Re-enable dynamo tests (#4454)
edc4cf72
alanwaketan [Functionalization] Fix test_simple_expand_on_2d_tensor (#4452)
25538575
wonjoo-wj Lower _prelu_kernel to fix prelu cpp tests
462f1aa2
wonjoo-wj Lower diag_embed to fix diagflat cpp tests
e4c4e893
wonjoo-wj Lower copy_ and copy ops to fix instance_norm op tests
1b02433d
wonjoo-wj Update DiagFlat cpp unit tests expected counter changes
6d0405c1
wonjoo-wj Rename prelu to _prelu_kernel and update diag_embed op to functioanli…
abc373db
wonjoo-wj Run linter
b4da21b2
wonjoo-wj Update copy_ op
456a38ca
wonjoo-wj Enable TestEinsumPyTorchLowerRepeatedAxisBackward cpp test
eaea4c77
vanbasten23 remove skip test on "test_simple_expand". (#4481)
3b52048a
alanwaketan [Functionalization] Fix torch.distributed tests (#4477)
24b1f651
alanwaketan [Functionalization] Mark test_logcumsumexp NTBF (#4506)
8e0835cc
alanwaketan Skip test_exponential
7f237a56
alanwaketan Turn on keep going
834f3f50
alanwaketan Skip dynamic shape tests again
bd0c9b6b
alanwaketan Revert "Turn on keep going"
ec3a6963
alanwaketan [Functionalization] Mark test_narrow_copy_non_contiguous won't fix (#…
3d60a23e
alanwaketan [Functionalization] Re-enable some of the dynamic shape test (#4518)
43536e24
wonjoo-wj [Functionalization] Fix more cpp tests that require new lowerings (#4…
b6e81372
alanwaketan skip dynamic shape tests again
82a89b4d
alanwaketan Turn on keep going
e0f5dfb1
alanwaketan Revert "skip dynamic shape tests again"
100c4485
alanwaketan [Functionalization] Fix ScatterReduce (#4576)
135e0e4f
wonjoo-wj Add debugging print lines
d228571d
wonjoo-wj Run linter again
2f3dc479
wonjoo-wj Update torch pin
b75adde5
wonjoo-wj Add more debugging lines
ca92a1cc
wonjoo-wj Lower lift and lift_copy ops
a3462c54
wonjoo-wj Update XLATensor namespace calls to tensor_methods
f96fa13b
wonjoo-wj Update pytorch_test_base.py
8c87e51c
wonjoo-wj Disable failing tests for now
e39d8255
wonjoo-wj Update lift_fresh ops
ff5d44f7
alanwaketan PoC for detach_copy
f05dcb97
alanwaketan Refine the comment
1a0c55f2
bdhirsh POC of functionalization integration
f082f286
wonjoo-wj Add debugging print lines
511cd7d7
wonjoo-wj Run linter
a999a144
wonjoo-wj Run linter again
cbffcacd
wonjoo-wj Update torch pin
2ed5ec24
wonjoo-wj Add more debugging lines
c37ff8b5
wonjoo-wj Update XLATensor namespace calls to tensor_methods
4f1c8bd6
wonjoo-wj Disable more failing tests
c29450b2
wonjoo-wj Run linter
fc227d35
wonjoo-wj Disable more tests
bc57c8f1
wonjoo-wj Clean up some comments
945ce35c
alanwaketan Skip test_empty_strided
a27bfd07
alanwaketan Fix detach_copy
4ad080b1
alanwaketan Skip some test_operations.py tests
558c8ada
wonjoo-wj Enable test_advancedindex_mixed_cpu_devices_xla
4834c26c
wonjoo-wj Remove some comments
4bc241b7
wonjoo-wj Enable test_basic_advanced_combined_xla
b0512b06
alanwaketan Skip test_squeeze_nonzero
70484f49
wonjoo-wj Enable tests in test_embedding and test_pooling
e70093db
alanwaketan Fix crash on test_empty_strided
1910a524
alanwaketan Fix index ops
2f38ae0b
alanwaketan Lower _to_copy
21cf6d5b
alanwaketan unskip test_squeeze_nonzero
bffe20cc
alanwaketan Skip test_squeeze_nonzero as it fails with dynamic shapes
c73c31e6
wonjoo-wj Fix test_affine tests by lowering affine_grid_generator
fc92fff3
wonjoo-wj Move affine_grid_generator to functionalization ops
b1e831eb
wonjoo-wj Delete debugging cout statements
4943c5c8
wonjoo-wj Run linter
d1ebfb3e
wonjoo-wj Lower _euclidean_dist
c68bf5b3
alanwaketan lower copy
ea0ae0b8
alanwaketan Route embeeding to functionalize pass
c66f5854
alanwaketan Lower reshape
2701b654
alanwaketan Introduce xla_expand_outplace
e3a360d7
alanwaketan lower mvlgamma
382f4dc2
alanwaketan lower masked_scatter
25e21c6c
wonjoo-wj Lower zeros_symint
29b3c5eb
wonjoo-wj Move xla_expand_outplace to tensor_util.h
177f0286
wonjoo-wj Add another xla_expand_outplace function to tensor_util.h to fix inde…
b4dacce0
wonjoo-wj Lower slice.Tensor
fd351730
wonjoo-wj Lower permute.Tensor
79841746
wonjoo-wj Lower select.int
811a4e4a
wonjoo-wj Lower t
2d2d1530
alanwaketan Skip test_nonzero_cast
a41d68f7
wonjoo-wj Disable some more failing tests
6222b03f
wonjoo-wj Disable failing XLA tests
d5642013
wonjoo-wj Enable test_mesh_service.py tests again to expose regression errors
37aecd4e
alanwaketan Skip even more tests
9cea4763
alanwaketan Revert masked_scatter
75c8d0bf
alanwaketan Revert "lower copy"
a4448a35
alanwaketan Revert "Lower zeros_symint"
8c40f3e5
alanwaketan Skip fsdp
138fd9a5
alanwaketan Skip more tests for GPU
7095c540
alanwaketan Adds some counters
398366a4
alanwaketan Fix linters
c2f8a126
alanwaketan Skip test_sizeAdd
8104de9a
alanwaketan Skip test_narrow_copy_non_contiguous
9e10f9f9
wonjoo-wj Run linter
1a69e3cb
wonjoo-wj Disable new dynamo tests that fail with functionalization
872badc2
wonjoo-wj Skip more spmd tests
c8533fe9
wonjoo-wj Set CONTINUE_ON_ERROR=true for testing
9734fcf3
alanwaketan Disable cpp tests
a6a9be9c
alanwaketan Disable Keep Going
d3466c37
alanwaketan [Functionalization] Enable cpp tests (#4462)
7f93346f
wonjoo-wj Re-enable dynamo tests (#4454)
edc4cf72
alanwaketan [Functionalization] Fix test_simple_expand_on_2d_tensor (#4452)
25538575
wonjoo-wj Lower _prelu_kernel to fix prelu cpp tests
462f1aa2
wonjoo-wj Lower diag_embed to fix diagflat cpp tests
e4c4e893
wonjoo-wj Lower copy_ and copy ops to fix instance_norm op tests
1b02433d
wonjoo-wj Update DiagFlat cpp unit tests expected counter changes
6d0405c1
wonjoo-wj Rename prelu to _prelu_kernel and update diag_embed op to functioanli…
abc373db
wonjoo-wj Run linter
b4da21b2
wonjoo-wj Update copy_ op
456a38ca
wonjoo-wj Enable TestEinsumPyTorchLowerRepeatedAxisBackward cpp test
eaea4c77
vanbasten23 remove skip test on "test_simple_expand". (#4481)
3b52048a
alanwaketan [Functionalization] Fix torch.distributed tests (#4477)
24b1f651
alanwaketan [Functionalization] Mark test_logcumsumexp NTBF (#4506)
8e0835cc
alanwaketan Skip test_exponential
7f237a56
alanwaketan Turn on keep going
834f3f50
alanwaketan Skip dynamic shape tests again
bd0c9b6b
alanwaketan Revert "Turn on keep going"
ec3a6963
alanwaketan [Functionalization] Mark test_narrow_copy_non_contiguous won't fix (#…
3d60a23e
alanwaketan [Functionalization] Re-enable some of the dynamic shape test (#4518)
43536e24
wonjoo-wj [Functionalization] Fix more cpp tests that require new lowerings (#4…
b6e81372
alanwaketan skip dynamic shape tests again
82a89b4d
alanwaketan Turn on keep going
e0f5dfb1
wonjoo-wj Lower masked_scatter to fix masked_scatter op test in xla/test/test_o…
389ffe0c
alanwaketan Revert "Turn on keep going"
ccbe24f4
wonjoo-wj Update torch_pin to latest PyTorch PR
7468484f
vanbasten23 re-enable all ds failing tests in functionalization branch (#4598)
d0b84e38
wonjoo-wj Add debugging print lines
d228571d
wonjoo-wj Update XLATensor namespace calls to tensor_methods
f96fa13b
wonjoo-wj Disable failing tests for now
e39d8255
wonjoo-wj Update lift_fresh ops
ff5d44f7
alanwaketan PoC for detach_copy
f05dcb97
bdhirsh POC of functionalization integration
f082f286
wonjoo-wj Run linter
fc227d35
wonjoo-wj Enable tests in test_embedding and test_pooling
e70093db
wonjoo-wj Fix test_affine tests by lowering affine_grid_generator
fc92fff3
wonjoo-wj Run linter
d1ebfb3e
alanwaketan lower copy
ea0ae0b8
alanwaketan Introduce xla_expand_outplace
e3a360d7
wonjoo-wj Lower slice.Tensor
fd351730
wonjoo-wj Disable failing XLA tests
d5642013
alanwaketan Disable Keep Going
d3466c37
wonjoo-wj Re-enable dynamo tests (#4454)
edc4cf72
wonjoo-wj Lower diag_embed to fix diagflat cpp tests
e4c4e893
wonjoo-wj Enable TestEinsumPyTorchLowerRepeatedAxisBackward cpp test
eaea4c77
alanwaketan Revert "Turn on keep going"
ec3a6963
alanwaketan Turn on keep going
e0f5dfb1
alanwaketan Skip test_squeeze_nonzero
e4d1456f
alanwaketan [Functionalization] Enable FSDP (#4691)
f82f7180
alanwaketan alanwaketan force pushed from cf44d6fe to f82f7180 3 years ago
alanwaketan alanwaketan marked this pull request as ready for review 3 years ago
alanwaketan alanwaketan requested a review from JackCaoG JackCaoG 3 years ago
alanwaketan alanwaketan requested a review from vanbasten23 vanbasten23 3 years ago
alanwaketan alanwaketan requested a review from yeounoh yeounoh 3 years ago
alanwaketan
alanwaketan Properly skip tests that will be fixed later
4eed8452
alanwaketan alanwaketan changed the title POC of functionalization integration Functionalization integration 3 years ago
vanbasten23
vanbasten23 approved these changes on 2023-03-02
alanwaketan Skip DynamoTrainingOptimizerTest.test_resnet18
f9963f6c
alanwaketan alanwaketan added REMOVE_TORCH_PIN
JackCaoG
JackCaoG approved these changes on 2023-03-02
alanwaketan
alanwaketan alanwaketan merged e49df835 into master 3 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone