Bpe | npm.io

Fast and versatile tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization

0.10.1 • Published 1 year ago

n8n node for working with BPE Tokens with OpenAI's GPT models in mind.

0.1.1 • Published 3 years ago

GPT Turbo plugin that calculates your conversation size and cost

5.0.1 • Published 2 years ago

⏳ js-tiktoken on Cloudflare Pages

1.0.12 • Published 8 months ago

TypeScript version of PGN Tokenizer, a Byte Pair Encoding (BPE) tokenizer for Chess Portable Game Notiation (PGN).

0.1.6 • Published 9 months ago

Bpe Packages