iceberg
Spark:Add branch support to rewrite_data_files procedure
#14964
Open
Overview
Commits
22
Changes
View On GitHub

Spark:Add branch support to rewrite_data_files procedure #14964

97harsh wants to merge 22 commits into apache:main from 97harsh:feature/rewrite-data-files-branch-support
97harsh
97harsh Add branch support to rewrite_data_files procedure
88dfc142
github-actions github-actions added spark
github-actions github-actions added core
97harsh 97harsh marked this pull request as draft 9 days ago
97harsh Add toBranch() implementation and tests for rewrite_data_files procedure
91ccc440
97harsh gradlew -Dall
0e696f79
97harsh Fix tests for rewrite_data_files with branch support
8ce09211
97harsh 97harsh marked this pull request as ready for review 9 days ago
97harsh Fix constructor chain in RewriteDataFilesCommitManager to prevent NPE
975e6e79
pvary
pvary commented on 2026-01-05
97harsh 97harsh marked this pull request as draft 9 days ago
97harsh Fix rewrite_data_files to use branch snapshot instead of main
efb1d57c
97harsh Test: Verify branch snapshot lineage in rewrite_data_files test
5ab9d807
97harsh 97harsh marked this pull request as ready for review 9 days ago
97harsh Fix spotless formatting in test and action files
d4e0a6e5
pvary
pvary commented on 2026-01-05
97harsh Add precondition to check branch exists in rewrite_data_files
2f3ee601
97harsh 97harsh requested a review from pvary pvary 9 days ago
pvary
pvary commented on 2026-01-06
pvary
pvary commented on 2026-01-06
pvary
97harsh Refactor RewriteDataFilesProcedure to use concrete types in helper me…
40c5a4ad
97harsh Revert branch support from Spark 3.4, 3.5, 4.0
640603c6
97harsh Remove debug comment from branch compaction test
b4fcf5fc
97harsh Trigger CI
560ff4e2
97harsh Trigger CI
efd06dd6
pvary
pvary commented on 2026-01-06
pvary
pvary commented on 2026-01-06
pvary
pvary commented on 2026-01-06
pvary
pvary commented on 2026-01-06
Guosmilesmile
Guosmilesmile commented on 2026-01-06
97harsh Address PR review comments for branch compaction tests
649c4a77
97harsh 97harsh requested a review from pvary pvary 7 days ago
pvary
pvary commented on 2026-01-07
97harsh Remove unnecessary cast in RewriteDataFilesProcedure
72b40b3f
pvary
pvary approved these changes on 2026-01-07
Guosmilesmile
Guosmilesmile approved these changes on 2026-01-07
singhpk234
singhpk234 commented on 2026-01-07
huaxingao
huaxingao approved these changes on 2026-01-07
97harsh 97harsh requested a review from singhpk234 singhpk234 7 days ago
97harsh
dramaticlly
dramaticlly commented on 2026-01-07
97harsh Make toBranch(null) a no-op for default branch behavior
23ec30c9
97harsh
pvary
pvary commented on 2026-01-08
97harsh Align toBranch() with SnapshotProducer: default to MAIN_BRANCH and re…
21ba4199
97harsh Trigger Build
2e232c72
97harsh Fix null branch handling in RewriteDataFilesProcedure
870cc50c
97harsh 97harsh force pushed from 8f0b83cd to 870cc50c 4 days ago
97harsh 97harsh requested a review from pvary pvary 3 days ago
97harsh
huaxingao
pvary
pvary commented on 2026-01-12
pvary
pvary commented on 2026-01-12
pvary
pvary commented on 2026-01-12
97harsh Update spark/v4.1/spark/src/main/java/org/apache/iceberg/spark/proced…
f220b409
97harsh Fix effectively final variable for lambda capture
f7acee37
pvary
pvary approved these changes on 2026-01-13

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
spark core
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum