Tokenization Packages

An elegant armor-plated JavaScript lexer modelled after flex. Easily extensible to tailor to your need for perfection.

Easily create payment tokens using Flex API

API client for token processing by connecting to assca

Small, fast, event-driven, fault-tolerant html tokenizer. Works in node or browsers.

Easily create keys for use in a Flex API integration and verifying Flex token contents

A NLP library for Russian language

A Bedrock module to provide auto-rotating tokenizers

English word and sentence tokenizer, for natural language processing.

Tokenizing strings of text. Extracting arrays of words and optionally number, emojis, tags, usernames and email addresses from strings. For Node.js and the browser. When you need more than just [a-z] regular expressions.

Tokenization Service's Smart Contracts

Wix Restaurants credit-cards tokenizer

A simple iterative lexer written in TypeScript

Skyflow SDK for Node.js

Bedrock Tokenization Engine

Babel Street Analytics API Node.js client SDK

A tokenizer and lemmatizer for canonical terms in text

Node js client for skyflow API's

TokenEX Node.js library for API

Basic English tokenizer

Salient is a natural language processing and sentiment analysis library