Chore(ingest) : add tests on PDFs with fast strategy #614
add --preserve-downloads to all ingest tests
cfe09171
restruct output dir to end with ingest-output
b930daf9
Revert "restruct output dir to end with ingest-output"
bd3ba37f
add reprocess test
be8d8fb6
add test to test set
695ed8f1
specify download dir
fdbaeee7
local recursive
e7e2d1e6
skip s3 pdfs for now
89fce93c
no local-recursive to aviod cp -r
d1ce7783
expected output
681c4a80
remove duplicate
a771b31d
changelog and version
00821849
Merge branch 'main' into yuming/fast_tests_ingest
7eb4584b
yuming-long
marked this pull request as draft 2 years ago
Merge branch 'main' into yuming/fast_tests_ingest
8f262d11
s3 is backk
780816fc
Revert "no local-recursive to aviod cp -r"
b056d783
s3 recur
afdd2025
use cp -a instead
1e7910f2
expected output azure and s3
7c6d7e11
Merge branch 'main' into yuming/fast_tests_ingest
c81d65bc
put back comment
e875aacc
slack discord up
6828fcb6
Merge branch 'main' into yuming/fast_tests_ingest
b281ed90
no nned to preserve download in local test
43bb6fb4
local api
84ef99f5
put back
144eb189
Merge branch 'main' into yuming/fast_tests_ingest
261b630e
run is again
2df8c781
echo diff
cf5483df
Merge branch 'main' into yuming/fast_tests_ingest
6641bc75
changelog
47ffd154
python3.8 output
469071b7
Merge branch 'main' into yuming/fast_tests_ingest
425a23eb
feat: add functionality to sort elements in `partition_pdf` for `fast…
e6e79bad
test: update `metadata-exclude` in `test-ingest-pdf-fast-reprocess.sh`
e74c319d
test: update ingest test fixtures
89d62515
Merge branch 'main' into yuming/fast_tests_ingest
cdcc6c81
chore: update changelog & version
b81217de
test: handle the case where `el.coordinates` is `None`
1650ea37
test: update unit test function for `pdf`
1b328a7c
update discord fixtures
0d0cf52a
update slack fixture
9939b2f8
Merge branch 'main' into yuming/fast_tests_ingest
f8a6a538
Update __version__.py
526a3f9d
fix the bump
27a76274
cragwolfe
approved these changes
on 2023-06-10
cragwolfe
marked this pull request as ready for review 2 years ago
qued
approved these changes
on 2023-06-12
Merge branch 'main' into yuming/fast_tests_ingest
21a40829
cragwolfe
enabled auto-merge (squash) 2 years ago
cragwolfe
merged
2fbb1ccd
into main 2 years ago
cragwolfe
deleted the yuming/fast_tests_ingest branch 2 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub