xla
[SPMD] Multi-host batch sharded data loading
#5331
Merged
Overview
Commits
9
Changes
View On GitHub

[SPMD] Multi-host batch sharded data loading #5331

khatwanimohit merged 9 commits into master from mohit/dataloading
khatwanimohit
khatwanimohit khatwanimohit requested a review from jonb377 jonb377 2 years ago
khatwanimohit khatwanimohit force pushed from e77f08f5 to 165c739c 2 years ago
khatwanimohit khatwanimohit force pushed from 165c739c to ddf982c5 2 years ago
jonb377
jonb377 commented on 2023-07-21
khatwanimohit khatwanimohit requested a review from alanwaketan alanwaketan 2 years ago
khatwanimohit khatwanimohit requested a review from JackCaoG JackCaoG 2 years ago
alanwaketan
khatwanimohit khatwanimohit force pushed from 8617f072 to 2042f438 2 years ago
khatwanimohit khatwanimohit force pushed from 81cb07f6 to 09e94107 2 years ago
khatwanimohit khatwanimohit requested a review from jonb377 jonb377 2 years ago
khatwanimohit khatwanimohit marked this pull request as ready for review 2 years ago
jonb377
jonb377 commented on 2023-07-24
khatwanimohit khatwanimohit requested a review from jonb377 jonb377 2 years ago
jonb377
jonb377 commented on 2023-07-27
alanwaketan
alanwaketan commented on 2023-07-28
khatwanimohit khatwanimohit force pushed from b1cf8453 to 36b62928 2 years ago
khatwanimohit khatwanimohit force pushed from 36b62928 to da04c4c2 2 years ago
alanwaketan
alanwaketan commented on 2023-07-28
alanwaketan
alanwaketan approved these changes on 2023-07-28
alanwaketan
alanwaketan commented on 2023-07-28
jonb377
jonb377 approved these changes on 2023-07-28
khatwanimohit khatwanimohit force pushed from bbe2bc8f to 002a342b 2 years ago
khatwanimohit batch sharded
99e33856
khatwanimohit change get_indices logic
1ac26a3f
khatwanimohit fix tests
7688be40
khatwanimohit accept sharding_spec as argument
93aaa550
khatwanimohit Add test
2d21fff7
khatwanimohit lint fix
4fe4210a
khatwanimohit accept sharding_spec in CreateShardedData
b9ce99fe
khatwanimohit remove tensor_shape argument
48f12c5e
khatwanimohit khatwanimohit force pushed from 002a342b to 48f12c5e 2 years ago
khatwanimohit multihost changes
c7fcdfbc
jonb377
jonb377 approved these changes on 2023-08-03
khatwanimohit khatwanimohit force pushed from 70ae0d0e to c7fcdfbc 2 years ago
khatwanimohit khatwanimohit merged f2f877f8 into master 2 years ago
miladm
miladm commented on 2024-10-24
miladm
miladm commented on 2024-10-24

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum