feat: elasticsearch connector #817
ryannikolaidis
merged
47 commits into
main
from
elasticsearch-connector
feat: add first version design of Elasticsearch connector
ea8e8ff1
add .sh script for running, update main.py for running, add jq filter…
44e6c41e
add parallel processing via not sharing elasticsearch client between …
18ee4601
Add automated runs for elasticsearch ingest
4ef1009c
for ci, add test outputs, write the test script, invoke test script
7156982a
fix output folder paths for the ci test for elasticsearch connector
d4a51df9
update test fixtures for ci tests, fix test script for the ci
5f5ea937
add newlines to the end of test fixtures, fix test script to be able …
0bfb5121
add dependency setup and requirement compliance
f838101c
add argument compliance such as for --verbose and --reprocess
b6922125
add argument compliance such as for --verbose and --reprocess
ff6f5823
Merge branch 'elasticsearch-connector' of https://github.com/Unstruct…
e47f0a12
add docstrings, add potential fix for concatenate_dict_fields, add to…
95abf597
fix and extend concatenate_dict_fields, fix order of decorators for E…
64b84cb2
add TODO point for future reference
ae55763b
add cleanup for lingering empty directories
9370a41a
add fixes for typing, linting, and formatting checks (make check)
46396283
Merge 'main' into elasticsearch-connector
a0ad84a8
update changelog and version
9fda9f22
add shellcheck fixes and test fixture updates
213bf187
add shellcheck fixes and test fixture updates
2b74eab3
exclude metadata fields for test fixtures
40386ad3
Merge branch 'main' into elasticsearch-connector
830b7adb
ryannikolaidis
commented
on 2023-06-27
ryannikolaidis
commented
on 2023-06-27
ryannikolaidis
commented
on 2023-06-27
ryannikolaidis
commented
on 2023-06-27
ryannikolaidis
commented
on 2023-06-27
ryannikolaidis
commented
on 2023-06-28
ryannikolaidis
commented
on 2023-06-28
ryannikolaidis
commented
on 2023-06-28
ryannikolaidis
commented
on 2023-06-28
fix trap statements, reduce the number of test examples, include a lo…
5360a3b9
isolate elasticsearch cluster creation and filling in a new script
28740ce3
move elasticsearch creation helpers to script folder, modify ingest e…
8a5460f9
tie both the ES ingest test and the ES ingest example to helpers in s…
f30b3931
add shebang like for shellcheck
3b7e5f63
Merge main into elasticsearch-connector
f85193ab
Merge branch 'elasticsearch-connector' of https://github.com/Unstruct…
63a30999
add shellcheck fixes, update test fixtures due to difference in proce…
d6e5e37d
add shellcheck ignore lines for script calls
9cd0e83c
update connector based on the DRY connector mixins, update test fixtu…
df70ca3f
Merge branch 'main' into elasticsearch-connector
0f7da1f3
* add --name to docker container
65d50b14
add install to ingest workflow
24fa3583
update shebang
f074be3f
fix get object handling
2107877d
Update ingest test fixtures (#867)
8b40cac3
tidy
c9643273
Merge branch 'elasticsearch-connector' of github.com:Unstructured-IO/…
58a0c460
Merge branch 'main' into elasticsearch-connector
d1161ac4
tweak arg descriptions
d5b54d7a
update example with changes from test
e5e10d4b
Merge branch 'main' into elasticsearch-connector
decea031
disabled auto-merge 2 years ago
Manually disabled by user
Manually disabled by user
ryannikolaidis
approved these changes
on 2023-07-01
tidy
545cdaf4
Merge branch 'elasticsearch-connector' of github.com:Unstructured-IO/…
1602fb5e
Login to write a write a comment.
Login via GitHub