Text-processing

Semantically create chunks from large texts. Useful for workflows involving large language models (LLMs).

semantic chunking sentence similarity cosine chunk rag splitting transformers transformers.js

2.4.1 • Published 2 months ago

A highly efficient, isomorphic, full-featured, multilingual text search engine library, providing full-text search, fuzzy matching, phonetic scoring, document indexing and more, with micro JSON state hydration/dehydration in-browser and server-side.

search-engine full-text-search text-processing document-indexing fuzzy-matching multilingual BM25 n-gram multi-gram TF-IDF

1.8.1 • Published 2 years ago

generate excerpt from html text while preserving html structure

js excerpt html blog text-processing

1.0.4 • Published 4 years ago

NodeJS library that semantically chunks text and matches it against a user query using cosine similarity for precise and relevant text retrieval

semantic chunking text-chunking semantic-chunking semantic-analysis cosine-similarity text-similarity query-matching text-matching text-embedding

1.1.6 • Published 23 days ago

A utility library for full-text search in TypeScript

full-text-search text-search search typescript string-search text-processing search-kit search-utils korean-search string-matching

0.1.2 • Published 7 months ago

Determine the East Asian Width of a Unicode character

unicode east-asian-width eastasianwidth character string width text layout alignment fullwidth

1.3.0 • Published 4 months ago

12 3

Text-processing Packages

contacted-chunking

clientside-search

better-excerpt-html

chunk-match

fulltext-search-kit

get-east-asian-width