Tokenizer | npm.io

simple token breakdown utility

1.0.8 • Published 8 years ago

A tiny HTML5 lexer

lexer chunker tokenizer html html5 standard

1.0.0-rc.3 • Published 3 years ago

React-based typeahead using the Bootstrap theme

bootstrap bootstrap-tokenizer bootstrap-typeahead react react-bootstrap react-bootstrap-tokenizer react-bootstrap-typeahead tokenizer typeahead

1.1.1 • Published 8 years ago

(eventually) spec-compliant html 5 parser

html5 parser tokenizer

1.0.0 • Published 10 years ago

Validation Methods for CSS values

css parser css-parser css-value-parser ast lexer tokenizer validation validator cssinjs

0.0.3 • Published 8 years ago

for js jieba lib

analyzer chinese chinese segmentation dict javascript jieba optimizer pure pure javascript segment

1.0.12 • Published 3 years ago

A modern runtime text tokenizer, for modern web.

tokenizer auto complete

1.3.2 • Published 8 years ago

Syntax highlighter/tokenizer from ACE editor

ace tokenizer syntax highlighter hightlight

1.0.0 • Published 9 years ago

String scanner.

sscan string scanner tokenizer analysis

0.2.0 • Published 10 years ago

React-based typeahead using the Bootstrap theme

bootstrap bootstrap-tokenizer bootstrap-typeahead react react-bootstrap react-bootstrap-tokenizer react-bootstrap-typeahead tokenizer typeahead

1.4.7 • Published 7 years ago

An easy to hack, modular and extensible JavaScript to JavaScript compiler based on the ECMAScript 5th Edition Standard.

javascript compiler parser tokenizer ecmascript minifier syntax grammar module

1.0.4 • Published 10 years ago

A complex string based CSS managment library

css token tokenize tokenizer string selector grammar parser lexer spec

0.8.12 • Published 7 years ago

Extensible S-Expression parser & runtime infrastructure

ast clojure dsl interpreter lisp parser runtime s-expression tokenizer typescript

1.0.11 • Published 4 months ago

An expression tokenizer, parser and evaluator.

expression tokenizer parser evaluator

1.11.1 • Published 2 years ago

Tokenizer

lexer string tokenizer

0.4.3 • Published 5 years ago

Splits text into tokens in as many languages as possible, using libicu

token word tokenize tokenizer natural language processing language text icu

0.1.0 • Published 10 years ago

A small library for building toy lexers.

lex lexer scan scanner token tokenize tokenizer

0.3.2 • Published 8 years ago

Tokenize a string into multiple token classes using a set of regular expressions, and get them back in order!

regex tokenizer token regular expression

1.0.1 • Published 8 years ago

RegExp based lexer

regexp lexer scanner tokenizer parsing parser

0.0.10 • Published 9 years ago

SAX based evented streaming JSON parser in Typescript (browser and node)

sax json typescript comments parser stream streaming event tokenizer events

0.99.0 • Published 4 years ago

15 6 724 25

Tokenizer Packages

token-breakdown-js

tiny-html-lexer

react-bootstrap-typeahead-fdr

high5

bredon-validate

js-jieba

tokenizer.js

ace-tokenizer

sscan

react-bootstrap-typeahead-tabindex

js-compiler

virtual-stylesheets

@thi.ng/sexpr

expression-engine

@candlefw/wind

overview-js-tokenizer

scanty

regex-tokenizer

regexp-lexer

bass-clarinet-typed