Text-processing | npm.io

Semantically create chunks from large texts. Useful for workflows involving large language models (LLMs).

semantic chunking sentence similarity cosine chunk rag splitting transformers transformers.js

2.4.1 • Published 22 days ago

Visualization of statistic peaks and valleys TE ranks

cyprinq package-manager string-manipulation utility-functions string-operations text-processing text-manipulation string-helpers text-utilities text-helpers

1.0.6 • Published 3 months ago

BulkAI is a powerful Node.js CLI tool designed to automate the processing of markdown and text files using OpenAI's GPT-4.

markdown openai automation text-processing cli-tool

1.0.3 • Published 5 months ago

Chunked Augmented Generation (CAG) algorithm for processing large text inputs with AI models

cag cag-js chunked-augmented-generation ai text-processing chunking nlp language-model

1.0.4 • Published 1 month ago

A utility library for full-text search in TypeScript

full-text-search text-search search typescript string-search text-processing search-kit search-utils korean-search string-matching

0.1.2 • Published 6 months ago

Determine the East Asian Width of a Unicode character

unicode east-asian-width eastasianwidth character string width text layout alignment fullwidth

1.3.0 • Published 3 months ago