Semantic-chunking | npm.io

Use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.

text-distillation text-summarization text-compression token-management llm-distillery large-language-model LLM semantic-chunking text-processing AI-text-reduction

1.2.0 • Published 3 months ago

NodeJS library that semantically chunks text and matches it against a user query using cosine similarity for precise and relevant text retrieval

semantic chunking text-chunking semantic-chunking semantic-analysis cosine-similarity text-similarity query-matching text-matching text-embedding

1.1.5 • Published 7 days ago