[WIP] Core: Add Vortex format to Iceberg #15915
robert3005
wants to merge
36 commits into
apache:main
from
spiraldb:main
feat: FileFormat for VORTEX
970a0c73
bump vortex version, fix test
7bf41823
fix build
a76b605c
Add test variants
ea17d5c8
Apply azure properties to native reads
328837ed
azure scan testing
910c7558
remove unused
99c963ae
fixes for latest vortex
aa831c23
more
b1742a0d
fix schema for register
9943c319
wake up better
61c24cc5
get rid of prefetch
c0265014
actually pushdown
3faf8965
row splits
3398e9d9
correct?
8964f0b6
vortex
2a0172d8
idToConstantMapping handling
b1df4d2d
fix
32a66fed
chore: bump to vortex-jni 0.34.0 (#6)
5560ea0a
bump vortex to 0.36.1 (#7)
08ccc79d
fix: Properly handles conversion of Vortex Decimal types into Iceberg…
8e13cd50
fix: Propagate rowIndices over JNI to Vortex (#9)
b73b77c6
fix: Pushown Literal<Decimal> expressions (#10)
4b3c2ea0
fix: Propagate UnconvertibleExpression through OR
9d546cc9
fix: Memory leak of Vortex resources (#12)
12d7b7da
Rebase vortex integration on top of latest iceberg and vortex
1dd9e27f
Merge pull request #14 from spiraldb/rk/rebase
9094d66d
Merge branch 'apache:main' into main
6652ba1e
Implement writes for vortex (#15)
b2c068ed
Add iceberg metrics on write and implement in set predicate rewrite (…
3eaca06c
robert3005
changed the title 
Merge branch 'main' into rk/upstream
a505c28f
Merge pull request #20 from spiraldb/rk/upstream2
2d5dfaff
Merge branch 'main' into rk/upstream
0bfceac0
Merge pull request #22 from spiraldb/rk/upstream
26fbb1b9
Upgrade vortex to 0.72.0
cfd696bf
Add generic end-to-tend tests for Vortex (#24)
7da4fb33
Reviewers
No reviews
Assignees
No one assigned
Labels
API
spark
parquet
arrow
core
data
flink
MR
docs
build
hive
Specification
KAFKACONNECT
Milestone
No milestone
Login to write a write a comment.
Login via GitHub