unstructured
feat: Sharepoint connector
#918
Merged

feat: Sharepoint connector #918

ryannikolaidis merged 88 commits into main from sharepoint_connector
rvztz
Temp changes for onedrive connector
b510e2bd
Added logic to manage downloads
61ebc1a5
Added example for OneDrive connector
07f20376
Added initial script to test onedrive ingestor
2db73737
Fixed issues with nested directories
6ed94219
ryannikolaidis Make MS_CLIENT_ID and MS_CLIENT_CRED available to onedrive test script
4a7e4fa0
Linted
a516a912
Typing and variable naming
0677f615
Updated with most recent ci changes
e2466b38
ryannikolaidis Merge branch 'main' into onedrive_connector
46c84708
ryannikolaidis * add makefile install command
ce01d920
ryannikolaidis lint and tidy
388aa9bd
ryannikolaidis add onedrive test to test-ingest.sh
ed2f7a26
Unstructured-DevOps Update ingest test fixtures (#868)
c6428fa3
ryannikolaidis Merge branch 'main' into onedrive_connector
fa655e34
ryannikolaidis Merge branch 'onedrive_connector' of github.com:Unstructured-IO/unstr…
4bebd5aa
ryannikolaidis exclude date processed
32157e21
Unstructured-DevOps Update ingest test fixtures (#870)
d87aa1ed
Added test outputs and removed ID from filepaths
4c9e27e4
rvztz merged latest changes
d091ae38
rvztz Removed TYPECHECKING flag on import, adds DriveItem directly to type …
3cc236fb
Unstructured-DevOps Update ingest test fixtures (#883)
4a1ab3f6
ryannikolaidis add recursive to test
a823159a
Unstructured-DevOps Update ingest test fixtures (#885)
d33410ae
ryannikolaidis delete former expected results (before rename)
80a76430
ryannikolaidis Merge branch 'onedrive_connector' of github.com:Unstructured-IO/unstr…
795a7c0e
ryannikolaidis Merge branch 'main' into onedrive_connector
3c913fc2
ryannikolaidis lint
f5541c7b
rvztz Boilerplate code for sharepoint connector
ceef6764
rvztz Working version for sharepoint document connector. Pages are pending
f9ba413f
rvztz Merge branch 'main' into sharepoint_connector
56ae278a
rvztz rvztz requested a review from ryannikolaidis ryannikolaidis 2 years ago
rvztz rvztz assigned rvztz rvztz 2 years ago
ryannikolaidis ryannikolaidis marked this pull request as draft 2 years ago
ryannikolaidis
rvztz Sharepoint page content PoC
2a5a3d57
rvztz Linting
8adba193
ryannikolaidis
ryannikolaidis commented on 2023-07-13
ryannikolaidis
ryannikolaidis commented on 2023-07-13
rvztz Added docstring, changed variable name
0f5ff9f9
rvztz Merge branch 'main' into sharepoint_connector
8ed9fa29
ryannikolaidis ryannikolaidis changed the title Sharepoint connector feat: Sharepoint (cloud) connector 2 years ago
ryannikolaidis ryannikolaidis changed the title feat: Sharepoint (cloud) connector feat: Sharepoint connector (cloud) 2 years ago
rvztz Allows for tenant-wide processing of sites
8bf21562
rvztz Catches exceptions related to missing folder/empty pages. Added expec…
8b0c3f35
rvztz Merged main, adds requirements for sharepoint connector.
ae9dbf15
rvztz Changelog, linting
f833c3c4
rvztz Solves depency conflict, linting
2e93c752
rvztz rvztz marked this pull request as ready for review 2 years ago
rvztz Merge branch 'main' into sharepoint_connector
09e50a61
rvztz Re-linting
1ce6a0ab
rvztz Merge branch 'main' into sharepoint_connector
f2c662e2
rvztz Added traceability properties
c69e0d2e
ryannikolaidis ryannikolaidis changed the title feat: Sharepoint connector (cloud) feat: Sharepoint connector 2 years ago
ryannikolaidis
ryannikolaidis commented on 2023-07-25
ryannikolaidis
ryannikolaidis commented on 2023-07-25
ryannikolaidis
ryannikolaidis commented on 2023-07-25
ryannikolaidis
ryannikolaidis commented on 2023-07-25
ryannikolaidis
ryannikolaidis requested changes on 2023-07-25
ryannikolaidis
ryannikolaidis commented on 2023-07-25
ryannikolaidis
ryannikolaidis commented on 2023-07-25
ryannikolaidis
ryannikolaidis requested changes on 2023-07-25
rvztz Renames sharepoint CLI variables. Linting
faef98a7
rvztz Pins Office client version to 2.4.2. Renaming of sharepoint CLI argum…
ab884b53
rvztz Fixes issues when file/site pages is not found. Updates expected outp…
942957cb
rvztz Merge branch 'main' into sharepoint_connector
d24bbdd5
rvztz Linting, dependency recompiling
532a7c55
rvztz fix tests
fc06a1d7
rvztz Merge branch 'main' into sharepoint_connector
bf9729f7
rvztz Sharepoint CLI arguments refactor
a2644a59
rvztz Merge branch 'main' into sharepoint_connector
d580f5d1
rvztz versioning
2658b52e
rvztz Redundant argument test-ingest-sharepoint.sh
5cab32e3
rvztz Fix msal dependency issue
05a4abfc
rvztz Merge branch 'main' into sharepoint_connector
4be0a944
rvztz Solves pyjwt dependency conflict
320b215b
rvztz Wrong onedrive argument in test
0b7534f1
rvztz Fixes issue with onedrive expected output
af37aa63
ryannikolaidis
ryannikolaidis commented on 2023-08-02
ryannikolaidis
ryannikolaidis
ryannikolaidis commented on 2023-08-03
ryannikolaidis
ryannikolaidis commented on 2023-08-03
rvztz Updates CI ingest-test and expected-ingest output for onedrive
f97300b7
ryannikolaidis
ryannikolaidis commented on 2023-08-03
ryannikolaidis
ryannikolaidis commented on 2023-08-03
ryannikolaidis
ryannikolaidis commented on 2023-08-03
ryannikolaidis
ryannikolaidis commented on 2023-08-03
ryannikolaidis
ryannikolaidis commented on 2023-08-03
ryannikolaidis
ryannikolaidis commented on 2023-08-03
rvztz Removes --process-all flag. Reduces parameters return by record_locat…
32f146a3
rvztz Merge branch 'main' into sharepoint_connector
8d5ace56
ryannikolaidis Update ingest test fixtures (#1040)
9f3fdd40
rvztz Merge branch 'main' into sharepoint_connector
84a05fa1
ryannikolaidis
ryannikolaidis
rvztz Fixes typo
31b37f33
rvztz Forms filtering and .aspx renaming
507aac32
ryannikolaidis Update ingest test fixtures (#1050)
b8f25863
rvztz Ignoring meta.last_modified
b1c53bc3
ryannikolaidis Update ingest test fixtures (#1059)
a3d90a20
ryannikolaidis
ryannikolaidis commented on 2023-08-08
rvztz Update test_unstructured_ingest/test-ingest-sharepoint.sh
7cbc17a1
ryannikolaidis Update ingest test fixtures (#1062)
fd6dae3b
rvztz Merge branch 'main' into sharepoint_connector
a69d8384
ryannikolaidis
ryannikolaidis commented on 2023-08-08
ryannikolaidis Update ingest test fixtures (#1065)
aa39aa93
rvztz Removes existing expected-structured-output for sharepoint
2b645288
rvztz Merge branch 'sharepoint_connector' of github.com:Unstructured-IO/uns…
75137866
ryannikolaidis Update ingest test fixtures (#1066)
1a8c211d
rvztz Merge branch 'main' into sharepoint_connector
1f32f87d
ryannikolaidis
ryannikolaidis commented on 2023-08-08
ryannikolaidis
ryannikolaidis commented on 2023-08-08
ryannikolaidis
ryannikolaidis commented on 2023-08-08
rvztz Traceability properties in camel case
7f16765a
ryannikolaidis Update ingest test fixtures (#1067)
18ac5a45
ryannikolaidis
ryannikolaidis commented on 2023-08-09
ryannikolaidis
ryannikolaidis commented on 2023-08-09
ryannikolaidis
ryannikolaidis commented on 2023-08-09
rvztz Merge branch 'main' into sharepoint_connector
c654d479
rvztz Record locator property fix
bb1c7dfd
rvztz Cleans expected-output to get correct property
d5b00de2
ryannikolaidis
ryannikolaidis commented on 2023-08-09
ryannikolaidis Update ingest test fixtures (#1073)
b21ef05e
rvztz Version bump, removes unnecesary env variable from CI yaml
c0fbf169
ryannikolaidis
ryannikolaidis approved these changes on 2023-08-09
rvztz Omits test-ingest-confluence-diff
3d6d7afd
rvztz Merge branch 'main' into sharepoint_connector
7be8d84c
rvztz Version bump
ed7398fc
ryannikolaidis ryannikolaidis merged dee9b405 into main 2 years ago
ryannikolaidis ryannikolaidis deleted the sharepoint_connector branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone