pytorch-lightning
Add support for parallelizing processing parquet files across workers and nodes.
#19400
Merged
Overview
Commits
17
Changes
View On GitHub

Add support for parallelizing processing parquet files across workers and nodes. #19400

tchaton merged 17 commits into master from add_parquet_reader
tchaton
tchaton update
7d5c13ca
tchaton update
77ed46ad
github-actions github-actions added data (external)
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
c7517cf9
update
90ff250e
update
ff6cf65a
update
895c6c36
update
f7ef40e4
update
7c0829c5
github-actions github-actions added dependencies
tchaton tchaton changed the title Optimize processing parquet files Add support for parallelizing processing parquet files across workers and nodes. 2 years ago
tchaton tchaton marked this pull request as ready for review 2 years ago
tchaton tchaton requested a review from lantiga lantiga 2 years ago
tchaton tchaton requested a review from Borda Borda 2 years ago
tchaton tchaton requested a review from awaelchli awaelchli 2 years ago
tchaton Merge branch 'master' into add_parquet_reader
92eec053
github-actions
update
25ad0c9a
Merge branch 'add_parquet_reader' of https://github.com/Lightning-AI/…
a8b216e7
update
9851e3d2
update
9b0eaed1
lantiga
lantiga approved these changes on 2024-02-05
update
39dae841
dmitsf
dmitsf approved these changes on 2024-02-05
mergify mergify added ready to be merged
tchaton update
ae015d20
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
8fc93da3
update
0b3c09cc
tchaton tchaton merged 7dfc279b into master 2 years ago
tchaton tchaton deleted the add_parquet_reader branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready to be merged dependencies data (external)
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum