Tokeniser | npm.io

A fast tokenizer/lexer core that is well tested.

tokenizer tokeniser tokenize tokenise lexer token lex parser fast

0.2.2 • Published 3 years ago

Tokenize JavaScript

complexion javascript tokenizer tokeniser tokenize tokenise lexer token lex parser

0.2.2 • Published 3 years ago

A regular expression (RexExp) stream tokenizer.

streams through through2 tokenizer tokeniser regexp regex

0.2.2 • Published 8 years ago

Plugin which allows your users to select multiple items from a predefined list or ajax, using autocompletion as they type to find each item.

tokenizer tokeniser tokenize tokenise tags taggify keywords

1.3.5 • Published 3 years ago

HTML and CSS lexer aimed at code with fatal errors, accepts mixed coding languages

ast codsen css html lexer lint parse parsing processing token

7.0.24 • Published 24 days ago

Is a character on a given index a closing of an HTML attribute?

attribute character codsen emlint end ending ends html is lexer

4.0.19 • Published 24 days ago

Is given character suitable to be in an HTML attribute's name?

attribute character codsen emlint for html is lexer name parsing

4.0.7 • Published 4 months ago

A simple, Twitter-aware tokenizer.

tokenise tokenize tokenising tokenizing tokeniser tokenizer token twitter NLP language

7.1.0 • Published 2 months ago

Simple word tokeniser that ignores punctuation.

word tokeniser tokenizer nlp token

0.0.5 • Published 10 years ago

An HTML5 lexer

html5 compliant html lexer tokeniser tokenizer parser start-tag end-tag element

0.5.0 • Published 1 year ago

Time a JavaScript tokenizer

complexion tokenizer tokeniser tokenize tokenise profile

1.1.0 • Published 7 years ago

Tokenizes a text from left to right and returns the list of tokens with their types.

token tokenizer tokeniser

1.1.2 • Published 7 years ago

RFC1459 and IRCv3 protocol tokeniser

irc ircv3 rfc1459 tokeniser

2.0.0 • Published 3 years ago

Piecinise your strings!

pieciniser tokeniser language esolang estoric

0.0.1 • Published 9 years ago

An HTML5 lexer

html5 compliant html lexer tokeniser tokenizer parser start-tag end-tag element

0.0.9 • Published 9 months ago

Tokeniser Packages

complexion

complexion-js

regexp-stream-tokenizer

tokenize2

codsen-tokenizer

is-html-attribute-closing

is-char-suitable-for-html-attr-name

happynodetokenizer

tkn

html-lexer

complexion-time-map

js-tokeniser

irctokens

pieciniser

@alshdavid/html-lexer