Tokenizing | npm.io

A little helper for handling strings containing zero width control characters, ANSI styling, whitespaces, newlines, 💩, etc.

1.0.42 • Published 6 years ago

A simple, Twitter-aware tokenizer.

7.1.0 • Published 2 months ago

Tools for manipulating sentences

4.0.0 • Published 5 years ago

convert text stream to tokens

1.5.0 • Published 8 years ago

A little helper for handling strings containing zero width control characters, ANSI styling, whitespaces, newlines, etc.

1.0.36 • Published 7 years ago

Tokenizing Packages