Tokenizer Packages

Stringscanner performs lexical scanning operations on a string.

Regular expressions on list of objects

Converts text into tokens, as defined by provided syntax; Supports recursive sub-syntaxes, regular expressions, and more..

React-based typeahead and typeahead-tokenizer

React-based typeahead and typeahead-tokenizer

Module for fast css selector tokenization from string

Module for fast element to selector matching (with custom :hover, :focus etc. handing)

An interpreted dynamic class-based programming language

Stream transform that divide the input by a sperator token

Universal lexer, where you can pass your rules for lexical analytics

Yet another powerful tokenizer in js

Simple synchronous string tokenizer using Regex

A tool that generates a TypeScript file from your Jison grammar's semantic actions so the TypeScript compiler will check those semantic actions for errors.

Time a JavaScript tokenizer

Bredon plugin to transform initial values

Bredon plugin to normalize floating-point precision

A class-oriented programming-language

a simplified and optimized fork of oboejs

Distill rich entity data matched via typeahead input into simple visual abstractions.

tokenizer, lexer