xla
[SPMD] Use sharding annotation from XLATensor data as ground truth.
#4390

Merged

[SPMD] Use sharding annotation from XLATensor data as ground truth. #4390

yeounoh merged 10 commits into master from spmd_debug_linear_sharding

yeounoh added distributed

yeounoh assigned

yeounoh 3 years ago

yeounoh marked this pull request as draft 3 years ago

yeounoh force pushed from 97ebd87b to e75516e2 3 years ago

yeounoh force pushed from e75516e2 to a5fa9e9e 3 years ago

yeounoh force pushed from a5fa9e9e to bc30d8f3 3 years ago

yeounoh force pushed from bc30d8f3 to c81ff4a2 3 years ago

yeounoh force pushed from c81ff4a2 to 999df039 3 years ago

yeounoh force pushed from 999df039 to 39b4aa0d 3 years ago

yeounoh force pushed from 39b4aa0d to 4d9718da 3 years ago

yeounoh requested a review from

jonb377 3 years ago

yeounoh requested a review from

JackCaoG 3 years ago

yeounoh requested a review from

alanwaketan 3 years ago

yeounoh requested a review from

steventk-g 3 years ago

yeounoh marked this pull request as ready for review 3 years ago

yeounoh force pushed from 4d9718da to 554e4f72 3 years ago

yeounoh force pushed from 554e4f72 to f111f2f0 3 years ago

yeounoh force pushed from f111f2f0 to 5f327195 3 years ago

yeounoh marked this pull request as draft 3 years ago

yeounoh force pushed from 5f327195 to c025f995 3 years ago

yeounoh marked this pull request as ready for review 3 years ago

JackCaoG commented on 2022-12-27

yeounoh force pushed from c025f995 to fe1700d9 3 years ago

yeounoh force pushed from fe1700d9 to 20d3b7d4 3 years ago

yeounoh force pushed from 20d3b7d4 to 20282188 3 years ago

yeounoh force pushed from 20282188 to 2089b2ef 3 years ago

yeounoh force pushed from 2089b2ef to 5563796e 3 years ago

yeounoh force pushed from 5563796e to 354e1e98 3 years ago

yeounoh force pushed from 354e1e98 to b3b76e1b 3 years ago

yeounoh force pushed from b3b76e1b to a2817a4d 3 years ago

yeounoh added DO_NOT_MERGE_YET

[SPMD] Use sharding annotation from XLATensor data as ground truth.

30856f92

[SPMD] Copy sharding from XLATensor to XLATensor while copying

13673b3c

yeounoh force pushed from a2817a4d to 13673b3c 3 years ago

yeounoh removed DO_NOT_MERGE_YET

JackCaoG commented on 2023-01-03

yeounoh force pushed from d89d2aba to d4dc38ac 3 years ago

yeounoh force pushed from d4dc38ac to e0105e82 3 years ago

[SPMD] check for IR shardings in CollectSyncTensors

346a50c8

yeounoh force pushed from e0105e82 to 346a50c8 3 years ago

JackCaoG commented on 2023-01-04

[SPMD] preserve shrding if a new tensnor is created from a sharded IR…

3a3cbcad

[SPMD] test if the original sharding spec is preserved afeter clone()

6f36e5a0

yeounoh force pushed from 1c7449e3 to 6f36e5a0 3 years ago

yeounoh force pushed from 103edc41 to dbeeab92 3 years ago

yeounoh force pushed from dbeeab92 to 4221d2aa 3 years ago

yeounoh force pushed from 8e1fcafb to c9fc201d 3 years ago

yeounoh force pushed from c9fc201d to 4221d2aa 3 years ago

yeounoh force pushed from 4221d2aa to ac0439cd 3 years ago

yeounoh force pushed from ac0439cd to 192fdfa2 3 years ago

[SPMD] Persist IR sharding to XLATensor during construction, if a XLA…

46131994

[SPMD] Sync sharding annotatnions during CollectSyncTensors only

ff267ab6

yeounoh force pushed from 192fdfa2 to ff267ab6 3 years ago

[SPMD] verify if we could skip IR sharding sync in SetShardingSpec

4d8d5ca0

Revert "[SPMD] verify if we could skip IR sharding sync in SetShardin…

2c9f2336

yeounoh force pushed from 89452a7f to 2c9f2336 3 years ago

JackCaoG commented on 2023-01-04

JackCaoG approved these changes on 2023-01-04

yeounoh force pushed from 725e98d1 to 59f8f420 3 years ago

yeounoh force pushed from 59f8f420 to 7ebc24bd 3 years ago

yeounoh force pushed from 7ebc24bd to cb5a9dbd 3 years ago

* [SPMD] Add a comment on sharding inside Data

406dea6d

yeounoh force pushed from cb5a9dbd to 406dea6d 3 years ago

yeounoh merged 70109e15 into master 3 years ago

Reviewers

JackCaoG

jonb377

alanwaketan

steventk-g

Assignees

yeounoh

Labels

distributed

Milestone

No milestone

xla [SPMD] Use sharding annotation from XLATensor data as ground truth. #4390 Merged

[SPMD] Use sharding annotation from XLATensor data as ground truth. #4390

xla
[SPMD] Use sharding annotation from XLATensor data as ground truth.
#4390

Merged