Feat: Native hierarchies for docx element types #1505
newelh
merged
93 commits into
main
from
newelh/hierarchy-fast/docx
Feat: Introduce a naive hierarchy to unstructured elements
886304de
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
4b1f2319
Fix: Move hierarchy postprocessor to
eea4fb6e
Chore: cleanup
f5f9305f
Chore: update changelog
e3572133
Chore: tidy
57665c4d
chore: tidy
1b4331f8
Chore: type hints
faeda5da
Chore: Version bump
970ba9d4
Fix: More safely access category attribute
c6933176
feat: Nested hierarchy support and unit tests
0f62a667
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
3a9b086e
chore: tidy & check
bbc4e4cb
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
4d9372b3
Fix: move set hierarchy to elements, support category depth
e24c9129
Feat: support parent_ids for html tags
c0af2495
Chore: Tidy & Check
75db9b16
Chore: move hierachy check method to common
6939d3ea
tests: update email tests to not require a
61c450b0
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
d405e81f
Chore: Tidy
4b80816a
Fix: regression in hierarchy algo,
1ed92ffa
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
eef8dca2
Feat: Add table support to ruleset
8b6c2d58
Chore: tidy
ff6878c2
docs: small docs corrections
dd9c48da
config: Black config requires pyproject.toml
32941b6e
Test: Ignore parent_ids in ingest tests
62b5af36
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
adbca9e2
chore: sync version
c1c262cc
Test: Remove parent id's from more ingest tests
0144809f
Fix: Ignore parent_id and category_depth when
1fd02374
Fix: Ignore parent_id & category depth for
d2879aa5
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
a6056312
Chore: update version
3c28d5a8
Merge branch 'main' into newelh/hierarchy-fast/post-processor
aed5ae76
Chore: tidy
c5519808
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
4e44cf51
Chore: bump version
d418b681
typing: add type stubs for python-docx/pptx
7598d8eb
typing: docx.py type-checks clean on strict
ab66ead0
rfctr: move convert_and_partition_docx() up
a9e7f796
rfctr: mv Paragraph.runs monkey-patch to bottom
0e9521e9
rfctr: add initial _DocxPartitioner
3b6527c9
rfctr: replace partition_docx implementation ...
da57c46b
rfctr: move parameters to instance variables
0b78b43d
rfctr: add _DocxPartitioner._iter_document_elements()
807e57ff
rfctr: extract _DocxPartitioner._document
b52c42af
rfctr: incorporate ._element_contains_pagebreak()
1fd6778e
rfctr: extract ._document_contains_pagebreaks
513a0b7d
rfctr: extract ._last_modified (date)
c81e9cb6
rfctr: extract ._page_number, ._increment_page_number
00911ff7
rfctr: extract ._is_list_item()
9d23f008
rfctr: incorporate ._iter_paragraph_emphasis()
44704caf
rfctr: extract ._paragraph_emphasis
d6a7285a
rfctr: incorporate ._style_based_element_type()
964b544d
rfctr: incorporate ._parse_paragraph_text_for_element_type()
8f73d300
rfctr: extract ._paragraph_metadata()
fef52b39
rfctr: extract ._iter_maybe_paragraph_element()
8ce16ecd
rfctr: extract ._table_emphasis()
ad5b5aa6
rfctr: extract ._iter_table_element()
9c6f7adf
docx: add _SectBlockIterator
6ebee1b4
rfctr: install _SectBlockIterator
617ac426
docx: add ._iter_section_page_breaks()
6cc92497
rfctr: extract ._iter_section_headers()
5b0a5c04
rfctr: extract ._iter_section_footers()
28e67340
rfctr: extract ._iter_maybe_paragraph_page_breaks()
bff9b62f
rfctr: improve convert_and_partition_docx()
35b564c2
spike: refactor docx partitioner
3d5d93b1
Merge branch 'main' into newelh/hierarchy-fast/post-processor
b7c55356
Merge branch 'scanny/spike' of https://github.com/Unstructured-IO/uns…
5d56afc8
Feat: Category depth for docx elements
80ab3b4d
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
acbe0868
Chore: add note
664b9ff6
Chore: tidy
63ed9d94
Chore: remove print statements
21100726
Feat: Add ilvl xpath check for determining list/bullet item depth
96eb509a
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
88bd841c
Chore: remove print statements
f6c093c8
Chore: changelog
d6339562
Chore: revert pptx changes to match main
e0c3136e
Chore: tidy
c30b9753
Test: Add unit tests for docx native hierarchy and additional example…
2ea960cf
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
ec1eef78
Chore: update changelog
753af88c
Chore: Update document to have more narrative type text
7a9f3ffb
Merge branch 'main' of https://github.com/Unstructured-IO/unstructure…
c0a05fa1
Chore: tidy
eff78e44
Chore: tidy tests, make more maintainable/readable
b2c2bf1a
Chore: tidy
df9f5b78
Merge branch 'main' into newelh/hierarchy-fast/docx
1395e627
Chore: tidy
c5de28e1
Chore: version bump
8f2d968d
Login to write a write a comment.
Login via GitHub