iceberg
ca0c7a23 - Spark: Rewrite MERGE INTO and DELETE for only Iceberg tables (#2134)

Commit

4 years ago

Spark: Rewrite MERGE INTO and DELETE for only Iceberg tables (#2134) Co-authored-by: Dilip Biswal <dbiswal@adobe.com>

References

#2134 - Apply iceberg extensions for MERGE INTO and DELETE only for target iceberg table.

Author

dilipbiswal

dilipbiswal

Parents

Files10

spark3-extensions/src
- main/scala/org/apache/spark/sql/catalyst
  - analysis
    - AlignMergeIntoTable.scala
    - DeleteFromTablePredicateCheck.scala
    - MergeIntoTablePredicateCheck.scala
  - optimizer
    - OptimizeConditionsInRowLevelOperations.scala
    - PullupCorrelatedPredicatesInRowLevelOperations.scala
    - RewriteDelete.scala
    - RewriteMergeInto.scala
  - utils
    - PlanUtils.scala
- test/java/org/apache/iceberg/spark/extensions
  - TestDelete.java
  - TestMerge.java