langchain
74045bf5 - max length attribute for spacy splitter for large docs (#13875)

Commit
2 years ago
max length attribute for spacy splitter for large docs (#13875) For large size documents spacy splitter doesn't work it throws an error as shown in below screenshot. Reason its default max_length is 1000000 and there is no option to increase it. So i added it in this PR. ![image](https://github.com/langchain-ai/langchain/assets/73680423/613625c3-0e21-4834-9aad-2a73cf56eecc) --------- Co-authored-by: Bagatur <baskaryan@gmail.com>
Author
Parents
Loading