Roman/ingest refactor #978
rbiseck3
force pushed
from
dea54b35
to
0ffd0815
2 years ago
rbiseck3
force pushed
from
0f604e1c
to
f9ca7fba
2 years ago
rbiseck3
force pushed
from
f9ca7fba
to
b6d3047b
2 years ago
rbiseck3
force pushed
from
55d09fde
to
84ab4f1e
2 years ago
rbiseck3
force pushed
from
4a1299eb
to
b0ce6183
2 years ago
rbiseck3
force pushed
from
39ac8fa2
to
6645377b
2 years ago
Pull out s3 code as subcommand
e970a190
Pull out dropbox code as subcommand
3153584f
Pull out azure code as subcommand
45b6193d
Pull out fsspec code as subcommand
df4afa8e
Pull out github code as subcommand
5e9b4656
Pull out gitlab code as subcommand
a235d188
Pull out reddit code as subcommand
3f5a02a7
Pull out slack code as subcommand
46a92e93
Pull out discord code as subcommand
9e73878b
Pull out wikipedia code as subcommand
1047ff6f
Pull out gdrive code as subcommand
4ae26247
Pull out biomed code as subcommand
77ca2207
rename parameters
6dbeede9
Pull out onedrive code as subcommand
943ec22f
Pull out outlook code as subcommand
19cfb949
Pull out local code as subcommand
e18f595c
Pull out elasticsearch code as subcommand
df616674
Pull out confluence code as subcommand
577a1aba
Drop previous main file
076fc6fc
update changelog
4fbfa6f4
Add back in mp.Pool
5cf4bd11
Fix mypy issues with click
724ac363
Make sure all tests run with verbose flag
81a15d1e
refactor approach to dynamically add common options to each subcomman…
ef8d186f
Pull out some more shared options
e0d1d623
Support running code via python as well as cli
1ec941c0
update ingest readme and move it to the ingest folder
9c8e60ac
update usage in connector docs
958f4293
move local command arg in test
90a9e7de
Seperate out cli code from logic running unstructured
5c614fe0
rbiseck3
force pushed
from
fb61544f
to
5c614fe0
2 years ago
rbiseck3
force pushed
from
acc9f6a2
to
4e92efb1
2 years ago
rbiseck3
force pushed
from
4e92efb1
to
b5b73004
2 years ago
rbiseck3
force pushed
from
b5b73004
to
e3d40e52
2 years ago
Make some cli fields required rather than optional
a7bef2e0
rbiseck3
force pushed
from
e3d40e52
to
a7bef2e0
2 years ago
rename process -> processor
f5b1c4c5
Improve logger to avoid duplicate handlers
81659874
rbiseck3
merged
28214a6c
into main 2 years ago
rbiseck3
deleted the roman/ingest-refactor branch 2 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub