Tokenizer Packages

Flexibly generate design tokens from your Figma files

Forked version of kuromoji with better compatibility for browsers

Tokenize a string.

Split a string into an array of sentences.

JavaScript implementation of Japanese morphological analyzer

Configurable SQL formatter

The path pattern parser, that supports named variables, variable constraints, bash-like alternation, regular expressions, and wildcards.