PR #1132 Roman/delta table connector

Roman/delta table connector #1132

rbiseck3 merged 14 commits into main from roman/delta-table-connector

rbiseck3 requested a review from

ryannikolaidis 2 years ago

rbiseck3 force pushed from 18061b47 to 59962bc6 2 years ago

rbiseck3 marked this pull request as ready for review 2 years ago

ryannikolaidis commented on 2023-08-17

rbiseck3 force pushed from 8003256d to a9b2fbb1 2 years ago

rbiseck3 force pushed from db428cfa to 5808a89f 2 years ago

rbiseck3 force pushed from f0d45c76 to 993cd445 2 years ago

rbiseck3 force pushed from 993cd445 to b5d65624 2 years ago

ryannikolaidis approved these changes on 2023-08-21

Add connector code

bae98fa7

update CHANGELOG

4753984c

update CI files

8828eda5

Add CI env vars for aws creds

801c5047

Update ingest test fixtures (#1143)

c6ad03e0

add excluded metadata fields for ingest test

ed206c24

Update ingest test fixtures (#1144)

5a351dc0

refactor to process each parquet file rather than pyarrow batch

cda57b7b

Add better error messaging if file system dependency missing

4792fe9f

Roman/delta table connector <- Ingest test fixtures update (#1153)

5369cd35

Fix connector specific imports

58ab30dc

Add dedicated doc for delta table connector

fd77ec85

rbiseck3 force pushed from b5d65624 to fd77ec85 2 years ago

fix linting

e9094cc2

Merge branch 'main' into roman/delta-table-connector

09359f49

rbiseck3 merged 106ee965 into main 2 years ago

rbiseck3 deleted the roman/delta-table-connector branch 2 years ago

Reviewers

ryannikolaidis

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

unstructured Roman/delta table connector #1132 Merged

Roman/delta table connector #1132

unstructured
Roman/delta table connector
#1132

Merged