unstructured
feat(chunking): add inter-chunk overlap
#2309
Merged

feat(chunking): add inter-chunk overlap #2309

scanny merged 6 commits into main from scanny/inter-chunk-overlap
scanny
scanny scanny marked this pull request as ready for review 2 years ago
scanny scanny changed the base branch from main to scanny/intra-chunk-overlap 2 years ago
scanny scanny requested a review from christinestraub christinestraub 2 years ago
scanny scanny force pushed from 38f55d52 to 9e8ddcaf 2 years ago
Base automatically changed from scanny/intra-chunk-overlap to main 2 years ago
scanny scanny force pushed from 9e8ddcaf to 7b1680d1 2 years ago
christinestraub
christinestraub approved these changes on 2023-12-26
scanny rfctr: add ChunkingOptions.inter_chunk_overlap
b4d8abc3
scanny rfctr: add overlap to TablePreChunk
ab806a45
scanny rfctr: add overlap to TextPreChunk
25eb5232
scanny rfctr: PreChunkBuilder implements overlap
1f3944c7
scanny feat: PreChunkCombiner is overlap-aware
a1e98efc
scanny chore: add CHANGELOG entry
9a23e502
scanny scanny force pushed from 7b1680d1 to 9a23e502 2 years ago
scanny scanny merged 7a1e732a into main 2 years ago
scanny scanny deleted the scanny/inter-chunk-overlap branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone