Tokenize | npm.io

Generate search.json with tokenize

hexo pages hexo plugin search static tokenize

0.0.3 • Published 9 years ago

Split text into tokens.

nlp tokenizer tokenize browser node spit join text words

1.0.0 • Published 8 years ago

Pacote desenvolvido para ajudar a criar tokens rapidamente.

nubin nubinbrasil tokenizer tokenize token

1.0.1 • Published 4 years ago

Convenient lexical scanner inspired by Ruby StringScanner

stringscanner scanner string text textscanner lex lexer lexical analysis token

0.0.8 • Published 3 years ago

JavaScript library for tokenizing strings with regular expressions

lexer tokenizer syntax lex tokenize token parsing

2.2.0 • Published 3 years ago

get word counts / frequencies on a per-speaker or per-category basis, or as an aggregate

wordcount frequency speakers tokenize stem category nlp bayes predict

0.0.165 • Published 4 years ago

Convenient lexical scanner inspired by Ruby's StringScanner

x-scanner xscanner stringscanner scanner string text textscanner lex lexer lexical

0.4.9 • Published 3 years ago

Tokenizes an HTML string, extracting plain text while ignoring HTML tags

html plaintext text token tokenize strip nlp

1.0.3 • Published 11 months ago

Extracts plain text from Markdown strings

markdown plaintext text token tokenize strip nlp

1.0.3 • Published 11 months ago

json-operations allows you to work with JSON, parse in a standardized way, get tokenize JSON, etc...

json util utilities operations token tokenize tokenizer parser JSON.parse JSON

0.0.6 • Published 3 years ago

A CLI tool for converting JSX files into standard JS.

jsx transform jsx-transform convert parse tokenize tokenizer

1.1.7 • Published 2 years ago

Tokenizer for js, jsx, (ts, tsx)

js ts jsx tsx tokenize

0.2.9 • Published 2 years ago

A regex that tokenizes JavaScript.

JavaScript js token tokenize regex

5.0.0 • Published 1 year ago

A CLI command for converting JSX files into standard JS.

cli jsx transform jsx-transform h hyperscript htm convert parse tokenize

2.2.1 • Published 2 years ago

A connector for the Trustami.AI API.

ai nlp trustami summarize sentiment language keywords named entities entities tokenize

1.0.4 • Published 2 years ago

tokenize your data securely

token cookies tokenise tokenize jwt

1.1.0 • Published 4 years ago

iterator based tokenizer for writing parsers

lexer tokenize tokenizer parse parser

3.0.1 • Published 3 years ago

Package for card's tokenization

tokenize card payu

1.0.2 • Published 3 years ago

A comprehensive text formatting and manipulation library written in JS.

text-formatting text-manipulation tokenize normalize stop-words string-utility search-query case-conversion punctuation

0.0.2 • Published 2 years ago

Middleware for calling blockchain interactions in a web2 environment

legt web3 easy tokenize

0.0.0 • Published 1 year ago

15 6 7 8

Tokenize Packages

hexo-tokenize-search

hx-tokenizer

@nubinbrasil/tokenizer

@chupacabral/textscanner

@teplovs/lexer

word-counts-categorical

x-scanner

stophtml

stopmarkdown

json-operations

jsx-convert

jsx2tokens

js-akashcry-token

jsx-to-hyperscript

trustami-ai

tokie

tokenizer-next

@axontraining-sistemas/tokenize-card

@basd/formatter

@legt/token-service