unstructured
Roman/ingest refactor
#978
Merged

Roman/ingest refactor #978

rbiseck3 merged 33 commits into main from roman/ingest-refactor
rbiseck3
rbiseck3 rbiseck3 requested a review from ryannikolaidis ryannikolaidis 2 years ago
rbiseck3 rbiseck3 requested a review from cragwolfe cragwolfe 2 years ago
rbiseck3 rbiseck3 force pushed from dea54b35 to 0ffd0815 2 years ago
jasonbot
jasonbot commented on 2023-07-26
jasonbot
jasonbot commented on 2023-07-26
github-advanced-security
github-advanced-security commented on 2023-07-26
jasonbot
ryannikolaidis
rbiseck3 rbiseck3 force pushed from 0f604e1c to f9ca7fba 2 years ago
ryannikolaidis
ryannikolaidis commented on 2023-07-27
ryannikolaidis
ryannikolaidis
ryannikolaidis commented on 2023-07-27
ryannikolaidis
ryannikolaidis
ryannikolaidis commented on 2023-07-27
rbiseck3 rbiseck3 force pushed from f9ca7fba to b6d3047b 2 years ago
rbiseck3 rbiseck3 force pushed from 55d09fde to 84ab4f1e 2 years ago
rbiseck3 rbiseck3 force pushed from 4a1299eb to b0ce6183 2 years ago
rbiseck3 rbiseck3 force pushed from 39ac8fa2 to 6645377b 2 years ago
rbiseck3 Pull out s3 code as subcommand
e970a190
rbiseck3 Pull out dropbox code as subcommand
3153584f
rbiseck3 Pull out azure code as subcommand
45b6193d
rbiseck3 Pull out fsspec code as subcommand
df4afa8e
rbiseck3 Pull out github code as subcommand
5e9b4656
rbiseck3 Pull out gitlab code as subcommand
a235d188
rbiseck3 Pull out reddit code as subcommand
3f5a02a7
rbiseck3 Pull out slack code as subcommand
46a92e93
rbiseck3 Pull out discord code as subcommand
9e73878b
rbiseck3 Pull out wikipedia code as subcommand
1047ff6f
rbiseck3 Pull out gdrive code as subcommand
4ae26247
rbiseck3 Pull out biomed code as subcommand
77ca2207
rbiseck3 rename parameters
6dbeede9
rbiseck3 Pull out onedrive code as subcommand
943ec22f
rbiseck3 Pull out outlook code as subcommand
19cfb949
rbiseck3 Pull out local code as subcommand
e18f595c
rbiseck3 Pull out elasticsearch code as subcommand
df616674
rbiseck3 Pull out confluence code as subcommand
577a1aba
rbiseck3 Drop previous main file
076fc6fc
rbiseck3 update changelog
4fbfa6f4
rbiseck3 Add back in mp.Pool
5cf4bd11
rbiseck3 Fix mypy issues with click
724ac363
rbiseck3 Make sure all tests run with verbose flag
81a15d1e
rbiseck3 refactor approach to dynamically add common options to each subcomman…
ef8d186f
rbiseck3 Pull out some more shared options
e0d1d623
rbiseck3 Support running code via python as well as cli
1ec941c0
rbiseck3 update ingest readme and move it to the ingest folder
9c8e60ac
rbiseck3 update usage in connector docs
958f4293
ryannikolaidis move local command arg in test
90a9e7de
rbiseck3 Seperate out cli code from logic running unstructured
5c614fe0
rbiseck3 rbiseck3 force pushed from fb61544f to 5c614fe0 2 years ago
ryannikolaidis
ryannikolaidis commented on 2023-07-28
ryannikolaidis
ryannikolaidis commented on 2023-07-28
rbiseck3 rbiseck3 force pushed from acc9f6a2 to 4e92efb1 2 years ago
rbiseck3 rbiseck3 force pushed from 4e92efb1 to b5b73004 2 years ago
ryannikolaidis
ryannikolaidis commented on 2023-07-28
rbiseck3 rbiseck3 force pushed from b5b73004 to e3d40e52 2 years ago
rbiseck3 Make some cli fields required rather than optional
a7bef2e0
rbiseck3 rbiseck3 force pushed from e3d40e52 to a7bef2e0 2 years ago
rbiseck3 rename process -> processor
f5b1c4c5
ryannikolaidis
rbiseck3 Improve logger to avoid duplicate handlers
81659874
rbiseck3
ryannikolaidis
ryannikolaidis approved these changes on 2023-07-31
rbiseck3 rbiseck3 merged 28214a6c into main 2 years ago
rbiseck3 rbiseck3 deleted the roman/ingest-refactor branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone