x-scanner
Convenient lexical scanner inspired by Ruby's StringScanner
Convenient lexical scanner inspired by Ruby's StringScanner
get word counts / frequencies on a per-speaker or per-category basis, or as an aggregate
Tokenizes a text using regex rules and returns the tokens with their positions in the text given.
A connector for the Trustami.AI API.
A moo compatible tokenizer/lexer generator, sacrificing some performance for features.
A Smarter String Split. Preserve Separator and more!
Extracts plain text from Markdown strings
Tokenizes an HTML string, extracting plain text while ignoring HTML tags
iterator based tokenizer for writing parsers
tokenize your data securely
Package for card's tokenization
docast utility to parse docblocks
Parse and manipulate tokenized strings with ease!
Parse and manipulate tokenized strings with ease!
A gemtext (`text/gemini`) parser with support for streaming, ASTs, and CSTs
Lexer to tokenize CSS
A comprehensive text formatting and manipulation library written in JS.
Middleware for calling blockchain interactions in a web2 environment
A NodeJS library to tokenize strings
A General Purpose Toolkit Library for Javascript