Tokenizer | npm.io

Wix Restaurants credit-cards tokenizer

credit cards tokenizer tokenization pci

1.2.902 • Published 5 years ago

Simple algorithm to tokenize Chinese texts into words using CC-CEDICT.

chinese text tokenizer words language

2.4.0 • Published 6 years ago

A lightly-typescriptified version of jison

jison bison yacc parser generator lexer flex tokenizer compiler typescript

0.0.6 • Published 3 years ago

React-based typeahead and typeahead-tokenizer

react typeahead tokenizer autocomplete react-component

2.2.2 • Published 5 years ago

Navigate within a string

parser tokenizer string walk

1.0.7 • Published 3 years ago

Fork of css-tree with all but animatable CSS properties removed

css ast tokenizer parser walker lexer generator utils syntax validation

1.0.20 • Published 1 year ago

lexical analyzer generator used by jison

jison parser generator lexer flex tokenizer

0.6.1-215 • Published 8 years ago

A lightly-typescriptified lexical analyzer generator used by ts-jison

jison parser generator lexer flex tokenizer typescript

0.0.2 • Published 4 years ago

Vietnamese stopwords

vietnamses duyetdev stopwords nlp data mining nodejs mining tokenizer

0.0.2 • Published 10 years ago

Tokenizer that transforms a string of sentences into an array of white-space separated strings of tokens

tokenize tokenizer tokens tokenizes tokenized sentences

0.0.3 • Published 11 years ago

React-based typeahead and typeahead-tokenizer with mouseover

react typeahead tokenizer autocomplete react-component

0.0.5 • Published 10 years ago

Textmate based tokenization for CodeMirror

codemirror textmate tm tokenizer highlighter

1.1.0 • Published 4 years ago

A parser for the OScript language written in JavaScript.

ast oscript lexer tokenizer parser parsing

0.2.6 • Published 3 years ago

React-based typeahead using reactstrap with Bootstrap 4.0 beta 2. Fork of react-bootstrap-typeahead

bootstrap bootstrap-tokenizer bootstrap-typeahead react react-bootstrap react-bootstrap-tokenizer react-bootstrap-typeahead tokenizer typeahead reactstrap

1.0.1 • Published 8 years ago

String Tokenizer for Node.js using ICU's BreakIterators

icu tokenize tokenizer

2.0.0 • Published 2 years ago

String ngram splitter.

ngram split search tokenize tokenizer convert converter parse parser

0.2.1 • Published 6 years ago

Tokenize (Scan) JSDoc buffer

jsdoc token tokenizer lexer parser scanner scan

1.4.2 • Published 6 years ago

React-based typeahead using the Bootstrap theme

bootstrap bootstrap-tokenizer bootstrap-typeahead react react-bootstrap react-bootstrap-tokenizer react-bootstrap-typeahead tokenizer typeahead

0.9.0 • Published 8 years ago

A React.js component for tokenizing user input

react react-component tokenizer tokens input textarea

0.3.0 • Published 10 years ago

React-based typeahead and typeahead-tokenizer

react typeahead tokenizer autocomplete react-component

1.3.2 • Published 10 years ago

14 5 624 25

Tokenizer Packages

creditcards-tokenizer

chinese-tokenizer

ts-jison

react-typeahead-sppro

string-walker

css-tree-animatable

@gerhobbelt/jison-lex

ts-jison-lex

vietnamese-stopwords

tokepi

react-typeahead-mouseover

codemirror-textmate

oscript-parser

reactstrap-typeahead

@flowaccount/node-icu-tokenizer

ngramable

jsdoc-tokenizer

react-bootstrap-4-typeahead

react-tokenizer

miu-react-typeahead